9255 2016-03-14 20:51:27 +0000 Allow rootfs tasks to run in parallel with rpm 2016-08-15 15:48:56 +0000 1 1 7 Build System, Metadata & Runtime BitBake bitbake unspecified All Multiple RESOLVED FIXED High enhancement 2.2 M3 1 stevenrwalter stephano jose.perez.carranza mark.hatle poky.bs.watcher poky.watcher randy.macleod sgw francisco.j.pedraza.gonzalez --- --- Don't know oldest_to_newest 59959 0 3028 stevenrwalter 2016-03-14 20:51:27 +0000 Created attachment 3028 Allow rootfs tasks to run in parallel with rpm Give each rootfs its own RPM channel to use. This puts the RPM metadata in a private subdirectory of $WORKDIR, rather than living in DEPLOY_DIR where other tasks may race with it. This allows us to reduce the time that the rpm.lock is held to only the time needed to hardlink the RPMs, allowing the majority of the rootfs operation to run in parallel. 60087 1 richard.purdie 2016-03-17 14:54:56 +0000 Steven: Could I ask you to submit this on the mailing list please? We're past the feature freeze so this would go into 2.2 M1. There is some risk about systems with DEPLOY_DIR on a separate filesystem where large data copies would be needed but that is something we could likely accept. Mark: CC'd for reference. 3028 2016-03-14 20:51:27 +0000 2016-03-16 15:07:21 +0000 Allow rootfs tasks to run in parallel with rpm 0001-Allow-for-simultaneous-do_rootfs-tasks-with-rpm.patch text/x-diff 3391 stevenrwalter RnJvbSA4Njk4OGYwY2M4M2M5OWQxMmE4ZTkwNmRkNTQ0ZWYyNGZiMGExYWViIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBTdGV2ZW4gV2FsdGVyIDxzd2FsdGVyQGxleG1hcmsuY29tPgpE YXRlOiBXZWQsIDE2IERlYyAyMDE1IDE0OjM5OjExIC0wNTAwClN1YmplY3Q6IFtQQVRDSF0gQWxs b3cgZm9yIHNpbXVsdGFuZW91cyBkb19yb290ZnMgdGFza3Mgd2l0aCBycG0KCkdpdmUgZWFjaCBy b290ZnMgaXRzIG93biBSUE0gY2hhbm5lbCB0byB1c2UuICBUaGlzIHB1dHMgdGhlIFJQTSBtZXRh ZGF0YQppbiBhIHByaXZhdGUgc3ViZGlyZWN0b3J5IG9mICRXT1JLRElSLCByYXRoZXIgdGhhbiBs aXZpbmcgaW4gREVQTE9ZX0RJUgp3aGVyZSBvdGhlciB0YXNrcyBtYXkgcmFjZSB3aXRoIGl0LgoK VGhpcyBhbGxvd3MgdXMgdG8gcmVkdWNlIHRoZSB0aW1lIHRoYXQgdGhlIHJwbS5sb2NrIGlzIGhl bGQgdG8gb25seSB0aGUKdGltZSBuZWVkZWQgdG8gaGFyZGxpbmsgdGhlIFJQTXMsIGFsbG93aW5n IHRoZSBtYWpvcml0eSBvZiB0aGUgcm9vdGZzCm9wZXJhdGlvbiB0byBydW4gaW4gcGFyYWxsZWwu Ci0tLQogbWV0YS9jbGFzc2VzL3Jvb3Rmc19ycG0uYmJjbGFzcyB8ICA1IC0tLS0tCiBtZXRhL2xp Yi9vZS9wYWNrYWdlX21hbmFnZXIucHkgIHwgMTcgKysrKysrKysrKysrKystLS0KIDIgZmlsZXMg Y2hhbmdlZCwgMTQgaW5zZXJ0aW9ucygrKSwgOCBkZWxldGlvbnMoLSkKCmRpZmYgLS1naXQgYS9t ZXRhL2NsYXNzZXMvcm9vdGZzX3JwbS5iYmNsYXNzIGIvbWV0YS9jbGFzc2VzL3Jvb3Rmc19ycG0u YmJjbGFzcwppbmRleCBkODVkMDAxLi4xMDNkMGVlIDEwMDY0NAotLS0gYS9tZXRhL2NsYXNzZXMv cm9vdGZzX3JwbS5iYmNsYXNzCisrKyBiL21ldGEvY2xhc3Nlcy9yb290ZnNfcnBtLmJiY2xhc3MK QEAgLTI1LDExICsyNSw2IEBAIGRvX3Jvb3Rmc1tyZWNyZGVwdGFza10gKz0gImRvX3BhY2thZ2Vf d3JpdGVfcnBtIgogcm9vdGZzX3JwbV9kb19yb290ZnNbdmFyZGVwc2V4Y2x1ZGVdICs9ICJCVUlM RE5BTUUiCiBkb19yb290ZnNbdmFyZGVwc10gKz0gIlBBQ0tBR0VfRkVFRF9VUklTIgogCi0jIFJQ TSBkb2Vzbid0IHdvcmsgd2l0aCBtdWx0aXBsZSByb290ZnMgZ2VuZXJhdGlvbiBhdCBvbmNlIGR1 ZSB0byBjb2xsaXNpb25zIGluIHRoZSB1c2Ugb2YgZmlsZXMgCi0jIGluICR7REVQTE9ZX0RJUl9S UE19LiBUaGlzIGNhbiBiZSByZW1vdmVkIGlmIHBhY2thZ2VfdXBkYXRlX2luZGV4X3JwbSBjYW4g YmUgY2FsbGVkIGNvbmN1cnJlbnRseQotZG9fcm9vdGZzW2xvY2tmaWxlc10gKz0gIiR7REVQTE9Z X0RJUl9SUE19L3JwbS5sb2NrIgotZG9fcG9wdWxhdGVfc2RrW2xvY2tmaWxlc10gKz0gIiR7REVQ TE9ZX0RJUl9SUE19L3JwbS5sb2NrIgotCiBweXRob24gKCkgewogICAgIGlmIGQuZ2V0VmFyKCdC VUlMRF9JTUFHRVNfRlJPTV9GRUVEUycsIFRydWUpOgogICAgICAgICBmbGFncyA9IGQuZ2V0VmFy RmxhZygnZG9fcm9vdGZzJywgJ3JlY3JkZXB0YXNrJykKZGlmZiAtLWdpdCBhL21ldGEvbGliL29l L3BhY2thZ2VfbWFuYWdlci5weSBiL21ldGEvbGliL29lL3BhY2thZ2VfbWFuYWdlci5weQppbmRl eCA1ZGZmNmIzLi5mNjcwNzlmIDEwMDY0NAotLS0gYS9tZXRhL2xpYi9vZS9wYWNrYWdlX21hbmFn ZXIucHkKKysrIGIvbWV0YS9saWIvb2UvcGFja2FnZV9tYW5hZ2VyLnB5CkBAIC04LDYgKzgsNyBA QCBpbXBvcnQgcmUKIGltcG9ydCBiYgogaW1wb3J0IHRlbXBmaWxlCiBpbXBvcnQgb2UudXRpbHMK K2ltcG9ydCBvZS5wYXRoCiAKIAogIyB0aGlzIGNhbiBiZSB1c2VkIGJ5IGFsbCBQTSBiYWNrZW5k cyB0byBjcmVhdGUgdGhlIGluZGV4IGZpbGVzIGluIHBhcmFsbGVsCkBAIC0xMTQsNyArMTE1LDcg QEAgY2xhc3MgUnBtSW5kZXhlcihJbmRleGVyKToKICAgICAgICAgICAgIGRicGF0aCA9IG9zLnBh dGguam9pbihzZWxmLmQuZ2V0VmFyKCdXT1JLRElSJywgVHJ1ZSksICdycG1kYicsIGFyY2gpCiAg ICAgICAgICAgICBpZiBvcy5wYXRoLmV4aXN0cyhkYnBhdGgpOgogICAgICAgICAgICAgICAgIGJi LnV0aWxzLnJlbW92ZShkYnBhdGgsIFRydWUpCi0gICAgICAgICAgICBhcmNoX2RpciA9IG9zLnBh dGguam9pbihzZWxmLmRlcGxveV9kaXIsIGFyY2gpCisgICAgICAgICAgICBhcmNoX2RpciA9IG9z LnBhdGguam9pbihzZWxmLmQuZ2V0VmFyKCdXT1JLRElSJywgVHJ1ZSksICdycG1zJywgYXJjaCkK ICAgICAgICAgICAgIGlmIG5vdCBvcy5wYXRoLmlzZGlyKGFyY2hfZGlyKToKICAgICAgICAgICAg ICAgICBjb250aW51ZQogCkBAIC05MTUsOCArOTE2LDE4IEBAIGNsYXNzIFJwbVBNKFBhY2thZ2VN YW5hZ2VyKToKICAgICAgICAgY2hfYWxyZWFkeV9hZGRlZCA9IFtdCiAgICAgICAgIGZvciBjYW5v bmljYWxfYXJjaCBpbiBwbGF0Zm9ybV9leHRyYToKICAgICAgICAgICAgIGFyY2ggPSBjYW5vbmlj YWxfYXJjaC5zcGxpdCgnLScpWzBdCi0gICAgICAgICAgICBhcmNoX2NoYW5uZWwgPSBvcy5wYXRo LmpvaW4oc2VsZi5kZXBsb3lfZGlyLCBhcmNoKQotICAgICAgICAgICAgaWYgb3MucGF0aC5leGlz dHMoYXJjaF9jaGFubmVsKSBhbmQgbm90IGFyY2ggaW4gY2hfYWxyZWFkeV9hZGRlZDoKKyAgICAg ICAgICAgIGFyY2hfY2hhbm5lbCA9IG9zLnBhdGguam9pbihzZWxmLmQuZ2V0VmFyKCdXT1JLRElS JywgVHJ1ZSksICdycG1zJywgYXJjaCkKKyAgICAgICAgICAgIG9lLnBhdGgucmVtb3ZlKGFyY2hf Y2hhbm5lbCkKKyAgICAgICAgICAgIGRlcGxveV9hcmNoX2RpciA9IG9zLnBhdGguam9pbihzZWxm LmRlcGxveV9kaXIsIGFyY2gpCisgICAgICAgICAgICBpZiBub3Qgb3MucGF0aC5leGlzdHMoZGVw bG95X2FyY2hfZGlyKToKKyAgICAgICAgICAgICAgICBjb250aW51ZQorCisgICAgICAgICAgICBs b2NrZmlsZW5hbWUgPSBzZWxmLmQuZ2V0VmFyKCdERVBMT1lfRElSX1JQTScsIFRydWUpICsgIi9y cG0ubG9jayIKKyAgICAgICAgICAgIGxmID0gYmIudXRpbHMubG9ja2ZpbGUobG9ja2ZpbGVuYW1l LCBGYWxzZSkKKyAgICAgICAgICAgIG9lLnBhdGguY29weWhhcmRsaW5rdHJlZShkZXBsb3lfYXJj aF9kaXIsIGFyY2hfY2hhbm5lbCkKKyAgICAgICAgICAgIGJiLnV0aWxzLnVubG9ja2ZpbGUobGYp CisKKyAgICAgICAgICAgIGlmIG5vdCBhcmNoIGluIGNoX2FscmVhZHlfYWRkZWQ6CiAgICAgICAg ICAgICAgICAgYmIubm90ZSgnTm90ZTogYWRkaW5nIFNtYXJ0IGNoYW5uZWwgJXMgKCVzKScgJQog ICAgICAgICAgICAgICAgICAgICAgICAgKGFyY2gsIGNoYW5uZWxfcHJpb3JpdHkpKQogICAgICAg ICAgICAgICAgIHNlbGYuX2ludm9rZV9zbWFydCgnY2hhbm5lbCAtLWFkZCAlcyB0eXBlPXJwbS1t ZCBiYXNldXJsPSVzIC15JwotLSAKMi41LjAKCg==