Bug 12949

Summary: populate-volatiles.sh is slow with read-only rootfs
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Joshua Watt <JPEWhacker>
Component: coreAssignee: Joshua Watt <JPEWhacker>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium CC: meta.mr.watcher, meta.watcher
Version: 2.7   
Target Milestone: 2.7   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Joshua Watt 2018-10-03 14:35:14 UTC 
The populate-volatiles script can be very slow on a read-only rootfs (or any time the cache is disabled). I did some profiling, and 80% of the time is spent validating the volatiles files in the check_requirements function. When there are many volatiles files present, this step can easily consume several seconds.

As a quick proof of concept, I concatenated all of the volatiles files together into a single one before parsing and that significantly improved performance, since check_requirements was only called once.
Comment 1 Joshua Watt 2018-10-15 13:02:14 UTC 
Fixed in f380fac8a43a75861f3157777b12a317b985a5e1