Bug 12949 - populate-volatiles.sh is slow with read-only rootfs
Summary: populate-volatiles.sh is slow with read-only rootfs
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.7
Hardware: x86 Multiple
: Medium normal
Target Milestone: 2.7
Assignee: Joshua Watt
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2018-10-03 14:35 UTC by Joshua Watt
Modified: 2018-10-15 13:02 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Watt 2018-10-03 14:35:14 UTC
The populate-volatiles script can be very slow on a read-only rootfs (or any time the cache is disabled). I did some profiling, and 80% of the time is spent validating the volatiles files in the check_requirements function. When there are many volatiles files present, this step can easily consume several seconds.

As a quick proof of concept, I concatenated all of the volatiles files together into a single one before parsing and that significantly improved performance, since check_requirements was only called once.
Comment 1 Joshua Watt 2018-10-15 13:02:14 UTC
Fixed in f380fac8a43a75861f3157777b12a317b985a5e1