Bug 9255

Summary: Allow rootfs tasks to run in parallel with rpm
Product: [Build System, Metadata & Runtime] BitBake Reporter: Steven Walter <stevenrwalter>
Component: bitbakeAssignee: Stephano Cetola <stephano>
Status: RESOLVED FIXED QA Contact: Francisco Pedraza <francisco.j.pedraza.gonzalez>
Severity: enhancement    
Priority: High CC: jose.perez.carranza, mark.hatle, poky.bs.watcher, poky.watcher, randy.macleod, sgw
Version: unspecified   
Target Milestone: 2.2 M3   
Hardware: All   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Don't know
Attachments:
Description Flags
Allow rootfs tasks to run in parallel with rpm none

Description Steven Walter 2016-03-14 20:51:27 UTC 
Created attachment 3028 [details]
Allow rootfs tasks to run in parallel with rpm

Give each rootfs its own RPM channel to use.  This puts the RPM metadata
in a private subdirectory of $WORKDIR, rather than living in DEPLOY_DIR
where other tasks may race with it.

This allows us to reduce the time that the rpm.lock is held to only the
time needed to hardlink the RPMs, allowing the majority of the rootfs
operation to run in parallel.
Comment 1 Richard Purdie 2016-03-17 14:54:56 UTC 
Steven: Could I ask you to submit this on the mailing list please? We're past the feature freeze so this would go into 2.2 M1.

There is some risk about systems with DEPLOY_DIR on a separate filesystem where large data copies would be needed but that is something we could likely accept.

Mark: CC'd for reference.