14525 2021-08-26 13:32:16 +0000 rust-llvm isn't reproducible 2022-01-12 00:21:12 +0000 1 1 7 Build System, Metadata & Runtime OE-Core devtools / tool chain 3.3 x86 Multiple RESOLVED FIXED Medium+ normal 4.0 M2 1 richard.purdie pgowda.cve alex.kanavin meta.mr.watcher meta.watcher randy.macleod --- --- No (bug/feature does not impact docs) oldest_to_newest 91269 0 richard.purdie 2021-08-26 13:32:16 +0000 rust-llvm-liblto and rust-llvm-staticdev don't always reproduce: https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20210825-kaihham6/ https://autobuilder.yoctoproject.org/typhoon/#/builders/116/builds/595 91270 1 richard.purdie 2021-08-26 13:40:07 +0000 Workaround to avoid failures added for now: http://git.yoctoproject.org/cgit.cgi/poky/commit/?h=master-next&id=7d196f4e9a1957db0119952e59c7d0497c128521 91271 2 richard.purdie 2021-08-26 13:40:36 +0000 "oeqa/selftest/reproducibile: Exclude rust packages" 91281 3 randy.macleod 2021-08-26 14:51:59 +0000 usually make is file globing things and that's not deterministic. 91668 4 pgowda.cve 2021-10-05 15:29:42 +0000 Ran the following command on many poky sources ranging from Aug 25(when rust tests were marked exclude) to current sources. "oe-selftest -r reproducible" However, could not see the error message displayed in build-595. I am running the above test in Debian environment shared by Richard. Please let me know if anything is amiss from my side to run the test. Can we include the rust tests in reproducible suite? Please find attached the oe-selftest log that was run on current sources. It mentions that rust-llvm-liblto and rust-llvm-staticdev have same rpm, ipk and deb packages in reproducibleA and reproducibleB. Thanks, pgowda 91669 5 4837 pgowda.cve 2021-10-05 15:31:45 +0000 Created attachment 4837 oe-seltest result log 91673 6 randy.macleod 2021-10-06 20:05:32 +0000 Naveen, did you revert the commit mentioned in: https://bugzilla.yoctoproject.org/show_bug.cgi?id=14525#c1 91674 7 pgowda.cve 2021-10-07 04:39:10 +0000 Hi Randy, The patch which adds rust-llvm-liblto and rust-llvm-staticdev in exclude_packages was reverted before running the test. Please find attached the "oe-selftest-results-without-patch.log" that was run without reverting the patch for same source. 91675 8 4838 pgowda.cve 2021-10-07 04:39:55 +0000 Created attachment 4838 oe selftest log without patch 91692 9 randy.macleod 2021-10-07 15:15:46 +0000 We need to look at the last few master builds to see if rust builds reproducibly. Apparently the exclude does not stop the test but only stops the reproducible build test from failing. 91693 10 randy.macleod 2021-10-07 15:17:21 +0000 eg https://autobuilder.yoctoproject.org/typhoon/#/builders/115/builds/785/steps/13/logs/stdio 91696 11 randy.macleod 2021-10-08 01:30:33 +0000 Naveen, You may have to look at the data under: https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20211006-ed3f97d6/ I got here from: https://autobuilder.yoctoproject.org/typhoon/#/builders/115 and digging through each record looking for "repro-fail". I looked around a bit and I don't see a rust reproducible build failure. If you can confirm that by looking at more reproducible build logs, then plase submit a patch to take rust out of the exclude list and RP will schedule a YP AB run to confirm. 91698 12 pgowda.cve 2021-10-08 08:45:34 +0000 Checked the builds for around 20 days in reproducible tests and the results are fluctuating. https://autobuilder.yoctoproject.org/typhoon/#/builders/115 Some tests FAIL in some builds and are not constants. Even though the rust tests are excluded, reproducible tests FAIL for many other packages but not regularly. I have also included RUST tests in reproducible testsuite for poky sources around 2 months and did not notice any failure. These tests were run under Debain poky-master environment. Hence, the rust packages are included in reproducible tests and posted as https://lists.openembedded.org/g/openembedded-core/message/156772 92271 13 randy.macleod 2022-01-12 00:21:12 +0000 Fixed by Alex: https://git.openembedded.org/openembedded-core/commit/?id=a845029df7ea8c1bd987ffac3902d4521742debb Thanks! 4837 2021-10-05 15:31:45 +0000 2021-10-05 15:31:45 +0000 oe-seltest result log oe-selftest-results.log application/octet-stream 2991 pgowda.cve MjAyMS0xMC0wNSAxMDowMTo1OCwyMDEgLSBvZS1zZWxmdGVzdCAtIFdBUk5JTkcgLSBtZXRhLXNl bGZ0ZXN0IGxheWVyIG5vdCBmb3VuZCBpbiBCQkxBWUVSUywgYWRkaW5nIGl0CjIwMjEtMTAtMDUg MTA6MDI6MDQsNDE3IC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gQWRkaW5nIGxheWVyIGxpYnJhcmll czoKMjAyMS0xMC0wNSAxMDowMjowNCw0MTcgLSBvZS1zZWxmdGVzdCAtIElORk8gLSAJL2FsYS1s cGdncDMxL25nb3dkYS90aWNrZXRzL0J1Zy0xNDUyNS9wb2t5L21ldGEvbGliCjIwMjEtMTAtMDUg MTA6MDI6MDQsNDE4IC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gCS9hbGEtbHBnZ3AzMS9uZ293ZGEv dGlja2V0cy9CdWctMTQ1MjUvcG9reS9tZXRhLXlvY3RvLWJzcC9saWIKMjAyMS0xMC0wNSAxMDow MjowNCw0MTggLSBvZS1zZWxmdGVzdCAtIElORk8gLSAJL2FsYS1scGdncDMxL25nb3dkYS90aWNr ZXRzL0J1Zy0xNDUyNS9wb2t5L21ldGEtc2VsZnRlc3QvbGliCjIwMjEtMTAtMDUgMTA6MDI6MDQs NDIxIC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gUnVubmluZyBiaXRiYWtlIC1lIHRvIHRlc3QgdGhl IGNvbmZpZ3VyYXRpb24gaXMgdmFsaWQvcGFyc2FibGUKMjAyMS0xMC0wNSAxMDowMjowOCw4NDgg LSBvZS1zZWxmdGVzdCAtIElORk8gLSBBZGRpbmc6ICJpbmNsdWRlIHNlbGZ0ZXN0LmluYyIgaW4g L2FsYS1scGdncDMxL25nb3dkYS90aWNrZXRzL0J1Zy0xNDUyNS9idWlsZC1zdC9jb25mL2xvY2Fs LmNvbmYKMjAyMS0xMC0wNSAxMDowMjowOCw4NDkgLSBvZS1zZWxmdGVzdCAtIElORk8gLSBBZGRp bmc6ICJpbmNsdWRlIGJibGF5ZXJzLmluYyIgaW4gYmJsYXllcnMuY29uZgoyMDIxLTEwLTA1IDEw OjAyOjA4LDg0OSAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIHRlc3RfZGlmZm9zY29wZSAocmVwcm9k dWNpYmxlLkRpZmZvc2NvcGVUZXN0cykKMjAyMS0xMC0wNSAxMDoxMzowMyw2MzMgLSBvZS1zZWxm dGVzdCAtIElORk8gLSAgLi4uIG9rCjIwMjEtMTAtMDUgMTA6MTM6MDMsNjM1IC0gb2Utc2VsZnRl c3QgLSBJTkZPIC0gdGVzdF9yZXByb2R1Y2libGVfYnVpbGRzIChyZXByb2R1Y2libGUuUmVwcm9k dWNpYmxlVGVzdHMpCjIwMjEtMTAtMDUgMTA6MTQ6MDUsNTY2IC0gb2Utc2VsZnRlc3QgLSBJTkZP IC0gQnVpbGRpbmcgcmVwcm9kdWNpYmxlQSAoc3N0YXRlIGFsbG93ZWQpLi4uCjIwMjEtMTAtMDUg MTE6MzI6MjYsODg2IC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gQnVpbGRpbmcgcmVwcm9kdWNpYmxl QiAoc3N0YXRlIE5PVCBhbGxvd2VkKS4uLgoyMDIxLTEwLTA1IDEzOjExOjEwLDE2MCAtIG9lLXNl bGZ0ZXN0IC0gSU5GTyAtIENoZWNraW5nIGRlYiBwYWNrYWdlcyBmb3IgZGlmZmVyZW5jZXMuLi4K MjAyMS0xMC0wNSAxMzoxMjoyMCw2NTAgLSBvZS1zZWxmdGVzdCAtIElORk8gLSBSZXByb2R1Y2li aWxpdHkgc3VtbWFyeSBmb3IgZGViOiBzYW1lPTExMzM1IGRpZmZlcmVudD0wIGRpZmZlcmVudF9l eGNsdWRlZD0xMCBtaXNzaW5nPTAgdG90YWw9MTEzNDUKdW51c2VkX2V4Y2x1c2lvbnM9Wydnby0n LCAnZ28tcnVudGltZSddCjIwMjEtMTAtMDUgMTM6MTI6MjAsNjg5IC0gb2Utc2VsZnRlc3QgLSBJ TkZPIC0gQ2hlY2tpbmcgaXBrIHBhY2thZ2VzIGZvciBkaWZmZXJlbmNlcy4uLgoyMDIxLTEwLTA1 IDEzOjEzOjI1LDYyMyAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIFJlcHJvZHVjaWJpbGl0eSBzdW1t YXJ5IGZvciBpcGs6IHNhbWU9ODgyMCBkaWZmZXJlbnQ9MCBkaWZmZXJlbnRfZXhjbHVkZWQ9MTAg bWlzc2luZz0wIHRvdGFsPTg4MzAKdW51c2VkX2V4Y2x1c2lvbnM9Wydnby0nLCAnZ28tcnVudGlt ZSddCjIwMjEtMTAtMDUgMTM6MTM6MjUsNjUzIC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gQ2hlY2tp bmcgcnBtIHBhY2thZ2VzIGZvciBkaWZmZXJlbmNlcy4uLgoyMDIxLTEwLTA1IDEzOjE0OjM4LDg5 MSAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIFJlcHJvZHVjaWJpbGl0eSBzdW1tYXJ5IGZvciBycG06 IHNhbWU9ODgyMCBkaWZmZXJlbnQ9MCBkaWZmZXJlbnRfZXhjbHVkZWQ9MTAgbWlzc2luZz0wIHRv dGFsPTg4MzAKdW51c2VkX2V4Y2x1c2lvbnM9Wydnby1ydW50aW1lJywgJ2dvXyddCjIwMjEtMTAt MDUgMTM6MTQ6MzgsOTc4IC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gIC4uLiBvawoyMDIxLTEwLTA1 IDE1OjE4OjQ3LDc1NyAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIC0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KMjAyMS0x MC0wNSAxNToxODo0Nyw3NzAgLSBvZS1zZWxmdGVzdCAtIElORk8gLSBSYW4gMiB0ZXN0cyBpbiAx OTAwMS4zMDFzCjIwMjEtMTAtMDUgMTU6MTg6NDcsNzcwIC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0g T0sKMjAyMS0xMC0wNSAxNToxODo1OCwxNzAgLSBvZS1zZWxmdGVzdCAtIElORk8gLSBSRVNVTFRT OgoyMDIxLTEwLTA1IDE1OjE4OjU4LDE3MSAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIFJFU1VMVFMg LSByZXByb2R1Y2libGUuRGlmZm9zY29wZVRlc3RzLnRlc3RfZGlmZm9zY29wZTogUEFTU0VEICg2 NTQuNzlzKQoyMDIxLTEwLTA1IDE1OjE4OjU4LDE3MSAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIFJF U1VMVFMgLSByZXByb2R1Y2libGUuUmVwcm9kdWNpYmxlVGVzdHMudGVzdF9yZXByb2R1Y2libGVf YnVpbGRzOiBQQVNTRUQgKDEwODk1LjM0cykKMjAyMS0xMC0wNSAxNToxODo1OCw0MjkgLSBvZS1z ZWxmdGVzdCAtIElORk8gLSBTVU1NQVJZOgoyMDIxLTEwLTA1IDE1OjE4OjU4LDQyOSAtIG9lLXNl bGZ0ZXN0IC0gSU5GTyAtIG9lLXNlbGZ0ZXN0ICgpIC0gUmFuIDIgdGVzdHMgaW4gMTkwMDEuMzE1 cwoyMDIxLTEwLTA1IDE1OjE4OjU4LDQzMCAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIG9lLXNlbGZ0 ZXN0IC0gT0sgLSBBbGwgcmVxdWlyZWQgdGVzdHMgcGFzc2VkIChzdWNjZXNzZXM9Miwgc2tpcHBl ZD0wLCBmYWlsdXJlcz0wLCBlcnJvcnM9MCkK 4838 2021-10-07 04:39:55 +0000 2021-10-07 04:39:55 +0000 oe selftest log without patch oe-selftest-results-without-patch.log application/octet-stream 3141 pgowda.cve MjAyMS0xMC0wNSAxMToyNToxMCwxNTAgLSBvZS1zZWxmdGVzdCAtIFdBUk5JTkcgLSBtZXRhLXNl bGZ0ZXN0IGxheWVyIG5vdCBmb3VuZCBpbiBCQkxBWUVSUywgYWRkaW5nIGl0CjIwMjEtMTAtMDUg MTE6MjU6MTQsNzE1IC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gQWRkaW5nIGxheWVyIGxpYnJhcmll czoKMjAyMS0xMC0wNSAxMToyNToxNCw3MTUgLSBvZS1zZWxmdGVzdCAtIElORk8gLSAJL2FsYS1s cGdncDMxL25nb3dkYS90aWNrZXRzL2RlbC9wb2t5L21ldGEvbGliCjIwMjEtMTAtMDUgMTE6MjU6 MTQsNzE1IC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gCS9hbGEtbHBnZ3AzMS9uZ293ZGEvdGlja2V0 cy9kZWwvcG9reS9tZXRhLXlvY3RvLWJzcC9saWIKMjAyMS0xMC0wNSAxMToyNToxNCw3MTYgLSBv ZS1zZWxmdGVzdCAtIElORk8gLSAJL2FsYS1scGdncDMxL25nb3dkYS90aWNrZXRzL2RlbC9wb2t5 L21ldGEtc2VsZnRlc3QvbGliCjIwMjEtMTAtMDUgMTE6MjU6MTQsNzE3IC0gb2Utc2VsZnRlc3Qg LSBJTkZPIC0gUnVubmluZyBiaXRiYWtlIC1lIHRvIHRlc3QgdGhlIGNvbmZpZ3VyYXRpb24gaXMg dmFsaWQvcGFyc2FibGUKMjAyMS0xMC0wNSAxMToyNToxOCwxODMgLSBvZS1zZWxmdGVzdCAtIElO Rk8gLSBBZGRpbmc6ICJpbmNsdWRlIHNlbGZ0ZXN0LmluYyIgaW4gL2FsYS1scGdncDMxL25nb3dk YS90aWNrZXRzL2RlbC9idWlsZC1zdC9jb25mL2xvY2FsLmNvbmYKMjAyMS0xMC0wNSAxMToyNTox OCwxODMgLSBvZS1zZWxmdGVzdCAtIElORk8gLSBBZGRpbmc6ICJpbmNsdWRlIGJibGF5ZXJzLmlu YyIgaW4gYmJsYXllcnMuY29uZgoyMDIxLTEwLTA1IDExOjI1OjE4LDE4NCAtIG9lLXNlbGZ0ZXN0 IC0gSU5GTyAtIHRlc3RfZGlmZm9zY29wZSAocmVwcm9kdWNpYmxlLkRpZmZvc2NvcGVUZXN0cykK MjAyMS0xMC0wNSAxMTozOTowNywxMzAgLSBvZS1zZWxmdGVzdCAtIElORk8gLSAgLi4uIG9rCjIw MjEtMTAtMDUgMTE6Mzk6MDcsMTMxIC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gdGVzdF9yZXByb2R1 Y2libGVfYnVpbGRzIChyZXByb2R1Y2libGUuUmVwcm9kdWNpYmxlVGVzdHMpCjIwMjEtMTAtMDUg MTE6NDA6MjUsNTk4IC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gQnVpbGRpbmcgcmVwcm9kdWNpYmxl QSAoc3N0YXRlIGFsbG93ZWQpLi4uCjIwMjEtMTAtMDUgMTM6MTg6MjQsMTUxIC0gb2Utc2VsZnRl c3QgLSBJTkZPIC0gQnVpbGRpbmcgcmVwcm9kdWNpYmxlQiAoc3N0YXRlIE5PVCBhbGxvd2VkKS4u LgoyMDIxLTEwLTA1IDE0OjM2OjQ2LDY4NiAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIENoZWNraW5n IGRlYiBwYWNrYWdlcyBmb3IgZGlmZmVyZW5jZXMuLi4KMjAyMS0xMC0wNSAxNDozNzozMSw3NTQg LSBvZS1zZWxmdGVzdCAtIElORk8gLSBSZXByb2R1Y2liaWxpdHkgc3VtbWFyeSBmb3IgZGViOiBz YW1lPTExMzM2IGRpZmZlcmVudD0wIGRpZmZlcmVudF9leGNsdWRlZD05IG1pc3Npbmc9MCB0b3Rh bD0xMTM0NQp1bnVzZWRfZXhjbHVzaW9ucz1bJ2dvLScsICdnby1ydW50aW1lJywgJ3J1Ynktcmkt ZG9jcycsICdydXN0LWxsdm0tbGlibHRvJywgJ3J1c3QtbGx2bS1zdGF0aWNkZXYnXQoyMDIxLTEw LTA1IDE0OjM3OjMxLDc2OCAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIENoZWNraW5nIGlwayBwYWNr YWdlcyBmb3IgZGlmZmVyZW5jZXMuLi4KMjAyMS0xMC0wNSAxNDozODoxMSw4MjQgLSBvZS1zZWxm dGVzdCAtIElORk8gLSBSZXByb2R1Y2liaWxpdHkgc3VtbWFyeSBmb3IgaXBrOiBzYW1lPTg4MjEg ZGlmZmVyZW50PTAgZGlmZmVyZW50X2V4Y2x1ZGVkPTkgbWlzc2luZz0wIHRvdGFsPTg4MzAKdW51 c2VkX2V4Y2x1c2lvbnM9Wydnby0nLCAnZ28tcnVudGltZScsICdydWJ5LXJpLWRvY3MnLCAncnVz dC1sbHZtLWxpYmx0bycsICdydXN0LWxsdm0tc3RhdGljZGV2J10KMjAyMS0xMC0wNSAxNDozODox MSw4MzkgLSBvZS1zZWxmdGVzdCAtIElORk8gLSBDaGVja2luZyBycG0gcGFja2FnZXMgZm9yIGRp ZmZlcmVuY2VzLi4uCjIwMjEtMTAtMDUgMTQ6Mzg6NTEsNjc5IC0gb2Utc2VsZnRlc3QgLSBJTkZP IC0gUmVwcm9kdWNpYmlsaXR5IHN1bW1hcnkgZm9yIHJwbTogc2FtZT04ODIxIGRpZmZlcmVudD0w IGRpZmZlcmVudF9leGNsdWRlZD05IG1pc3Npbmc9MCB0b3RhbD04ODMwCnVudXNlZF9leGNsdXNp b25zPVsnZ28tcnVudGltZScsICdnb18nLCAncnVieS1yaS1kb2NzJywgJ3J1c3QtbGx2bS1saWJs dG8nLCAncnVzdC1sbHZtLXN0YXRpY2RldiddCjIwMjEtMTAtMDUgMTQ6Mzg6NTEsNzA5IC0gb2Ut c2VsZnRlc3QgLSBJTkZPIC0gIC4uLiBvawoyMDIxLTEwLTA1IDE2OjE0OjExLDQzMSAtIG9lLXNl bGZ0ZXN0IC0gSU5GTyAtIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KMjAyMS0xMC0wNSAxNjoxNDoxMSw0MzIgLSBv ZS1zZWxmdGVzdCAtIElORk8gLSBSYW4gMiB0ZXN0cyBpbiAxNzMzNS4wNTJzCjIwMjEtMTAtMDUg MTY6MTQ6MTEsNDMyIC0gb2Utc2VsZnRlc3QgLSBJTkZPIC0gT0sKMjAyMS0xMC0wNSAxNjoxNDoy MywwMTggLSBvZS1zZWxmdGVzdCAtIElORk8gLSBSRVNVTFRTOgoyMDIxLTEwLTA1IDE2OjE0OjIz LDAxOSAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIFJFU1VMVFMgLSByZXByb2R1Y2libGUuRGlmZm9z Y29wZVRlc3RzLnRlc3RfZGlmZm9zY29wZTogUEFTU0VEICg4MjguOTVzKQoyMDIxLTEwLTA1IDE2 OjE0OjIzLDAxOSAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIFJFU1VMVFMgLSByZXByb2R1Y2libGUu UmVwcm9kdWNpYmxlVGVzdHMudGVzdF9yZXByb2R1Y2libGVfYnVpbGRzOiBQQVNTRUQgKDEwNzg0 LjU4cykKMjAyMS0xMC0wNSAxNjoxNDoyMywyOTkgLSBvZS1zZWxmdGVzdCAtIElORk8gLSBTVU1N QVJZOgoyMDIxLTEwLTA1IDE2OjE0OjIzLDMwMCAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIG9lLXNl bGZ0ZXN0ICgpIC0gUmFuIDIgdGVzdHMgaW4gMTczMzUuMDU0cwoyMDIxLTEwLTA1IDE2OjE0OjIz LDMwMCAtIG9lLXNlbGZ0ZXN0IC0gSU5GTyAtIG9lLXNlbGZ0ZXN0IC0gT0sgLSBBbGwgcmVxdWly ZWQgdGVzdHMgcGFzc2VkIChzdWNjZXNzZXM9Miwgc2tpcHBlZD0wLCBmYWlsdXJlcz0wLCBlcnJv cnM9MCkK