Bug 9255 - Allow rootfs tasks to run in parallel with rpm
Summary: Allow rootfs tasks to run in parallel with rpm
Status: RESOLVED FIXED
Alias: None
Product: BitBake
Classification: Build System, Metadata & Runtime
Component: bitbake (show other bugs)
Version: unspecified
Hardware: All Multiple
: High enhancement
Target Milestone: 2.2 M3
Assignee: Stephano Cetola
QA Contact: Francisco Pedraza
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2016-03-14 20:51 UTC by Steven Walter
Modified: 2016-08-15 15:48 UTC (History)
6 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: Don't know


Attachments
Allow rootfs tasks to run in parallel with rpm (3.31 KB, text/x-diff)
2016-03-14 20:51 UTC, Steven Walter
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Steven Walter 2016-03-14 20:51:27 UTC
Created attachment 3028 [details]
Allow rootfs tasks to run in parallel with rpm

Give each rootfs its own RPM channel to use.  This puts the RPM metadata
in a private subdirectory of $WORKDIR, rather than living in DEPLOY_DIR
where other tasks may race with it.

This allows us to reduce the time that the rpm.lock is held to only the
time needed to hardlink the RPMs, allowing the majority of the rootfs
operation to run in parallel.
Comment 1 Richard Purdie 2016-03-17 14:54:56 UTC
Steven: Could I ask you to submit this on the mailing list please? We're past the feature freeze so this would go into 2.2 M1.

There is some risk about systems with DEPLOY_DIR on a separate filesystem where large data copies would be needed but that is something we could likely accept.

Mark: CC'd for reference.