| Summary: | AB-INT: rust do_create_spdx failure | ||
|---|---|---|---|
| Product: | [Build System, Metadata & Runtime] OE-Core | Reporter: | Alexandre Belloni <alexandre.belloni> |
| Component: | devtools / tool chain | Assignee: | Steve Sakoman <steve> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | normal | ||
| Priority: | Medium+ | CC: | alex.kanavin, alexandre.belloni, luca.ceresoli, meta.mr.watcher, meta.watcher, pavel, randy.macleod, richard.purdie, steve, sundeep.kokkonda, tgamblin |
| Version: | unspecified | ||
| Target Milestone: | 5.1 | ||
| Hardware: | x86 | ||
| OS: | Multiple | ||
| Whiteboard: | AB-INT | ||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | No (bug/feature does not impact docs) | |
|
Description
Alexandre Belloni
2023-08-10 14:20:45 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7658/steps/17/logs/stdio https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7658/steps/20/logs/stdio pkgman-non-rpm debian12-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7055/steps/16/logs/stdio qemuarm64-armhost ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7662/steps/18/logs/stdio https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7662/steps/21/logs/stdio pkgman-non-rpm opensuse153-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7059/steps/16/logs/stdio qemuarm64-armhost ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7656/steps/17/logs/stdio https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7656/steps/20/logs/stdio pkgman-non-rpm fedora38-ty-4 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7053/steps/15/logs/stdio qemuarm64-armhost ubuntu2204-arm-1 This is caused by rust not building reproducibly in a problematic way in that some of the files it generates have a hash(?) in the file name. This means that each time they build, the file names change, which doesn't play nice with hash equivalence. As such, the specific fix for rust is https://bugzilla.yoctoproject.org/show_bug.cgi?id=14875 but we will also work on being able to exclude recipes from hash equivalence so this can stop holding up the autobuilder. rust-1.70.0-r0 do_create_spdx: No package file found for /usr/lib/libchalk_derive-f4d6e50ab3565138.so in rust; SPDX found: usr/bin/rust-gdbgui usr/bin/rust-lldb usr/bin/rustdoc usr/bin/rustc usr/bin/cargo-fmt usr/bin/rust-gdb usr/libexec/rust-analyzer-proc-macro-srv usr/lib/libchalk_derive-adea65fd7ba2b9ed.so usr/lib/libtracing_attributes-fb18d423158cea89.so usr/lib/libyoke_derive-f91e34aa2c00164f.so usr/lib/libstd-bfd33050193f03d7.so usr/lib/libzerovec_derive-e2df2cd6f18530b4.so usr/lib/libdisplaydoc-7bd398277a9b52e3.so usr/lib/libcstr-c286151fc700d1e1.so usr/lib/libzerofrom_derive-916935233ad0caa5.so usr/lib/libtest-4a600a7f6843f3ba.so usr/lib/libicu_provider_macros-32d936faa80a1e84.so usr/lib/libthiserror_impl-33951919b52eced5.so usr/lib/librustc_driver-bd5db83498eeda92.so usr/lib/libunic_langid_macros_impl-0b5561affe3c001c.so usr/lib/libderive_more-19f210d5d21a6023.so usr/lib/libserde_derive-8dcaff1f6d13132f.so usr/lib/libproc_macro_hack-190cbac30d726747.so usr/lib/librustc_macros-e1ad0b0b41d051ec.so usr/lib/rustlib/rust-installer-version usr/lib/rustlib/components usr/lib/rustlib/etc/lldb_lookup.py usr/lib/rustlib/etc/gdb_lookup.py usr/lib/rustlib/etc/gdb_providers.py usr/lib/rustlib/etc/lldb_commands usr/lib/rustlib/etc/lldb_providers.py usr/lib/rustlib/etc/gdb_load_rust_pretty_printers.py usr/lib/rustlib/etc/rust_types.py usr/lib/rustlib/aarch64-poky-linux-gnu/target.json usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libprofiler_builtins-a8e4cb8875b8d3f5.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liballoc-6fa5ed2e6c0c88b5.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunicode_width-f97ea3f94b4a12db.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-bfd33050193f03d7.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_alloc-bb49f5c65d87273f.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgimli-3c025098a90bcde2.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_demangle-26e850066ede46fe.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_std-aac95da1b171f6d3.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libproc_macro-14cccdea1edb1998.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgetopts-c19745e74c103616.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libaddr2line-977f7bcf59de4701.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcfg_if-bd34e40c3cd07526.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcompiler_builtins-7ef113061109fd52.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-bfd33050193f03d7.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-4a600a7f6843f3ba.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_core-622605243f47e028.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-4a600a7f6843f3ba.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libminiz_oxide-35a2854f0dde1078.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libadler-dd909c85ea2b1df8.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcore-16d28e29ee3b6019.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libhashbrown-abea5d3d8d653ad8.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libmemchr-11e7da57dc06724d.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libobject-d0f8b33da5222583.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_abort-2f492bb9c6c31a4e.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd_detect-670836d512ce2d98.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_unwind-82ed36a7727c9107.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liblibc-c3f4600779f1d1bc.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunwind-f8f7739ebf0d332e.rlib https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7046/steps/15/logs/stdio qemuarm64-armhost ubuntu2204-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7377/steps/15/logs/stdio qemuarm64-armhost on ubuntu2204-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8232/steps/17/logs/stdio pkgman-non-rpm fedora38-ty-6 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8068/steps/17/logs/stdio pkgman-non-rpm fedora38-ty-6 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8061/steps/17/logs/stdio pkgman-non-rpm fedora38-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7937/steps/18/logs/stdio pkgman-non-rpm opensuse154-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8189/steps/17/logs/stdio pkgman-non-rpm fedora38-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8186/steps/17/logs/stdio pkgman-non-rpm fedora38-ty-6 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8185/steps/17/logs/stdio pkgman-non-rpm fedora38-ty-4 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8036/steps/17/logs/stdio pkgman-non-rpm fedora38-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7433/steps/16/logs/stdio qemuarm64-armhost ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8045/steps/18/logs/stdio pkgman-non-rpm alma8-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7441/steps/16/logs/stdio qemuarm64-armhost ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8018/steps/18/logs/stdio pkgman-non-rpm opensuse153-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7016/steps/15/logs/stdio qemuarm64-armhost ubuntu2204-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7225/steps/15/logs/stdio qemuarm64-armhost ubuntu2204-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7206/steps/15/logs/stdio qemuarm64-armhost ubuntu2204-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/8169/steps/15/logs/errors qemuarm64-armhost ubuntu2204-arm-1 The lib name changed: ERROR: rust-1.75.0-r0 do_create_spdx: No package file found for /usr/lib/libcstr-c8db9f0ec9917268.so in rust; SPDX found: usr/lib/libyoke_derive-25a214f8b8d74016.so usr/lib/libthiserror_core_impl-38cf786ec3162cdd.so usr/lib/libthiserror_impl-d977ab854f506513.so usr/lib/libdarling_macro-a65409ac38dbfc55.so usr/lib/libcstr-2811f578aee286ce.so usr/lib/libzerovec_derive-94666b998fff5f11.so usr/lib/libdisplaydoc-33439fe413a96058.so usr/lib/libserde_derive-369aa83e6b6a0b1f.so usr/lib/libderivative-5df6e2c6e981324e.so usr/lib/libderive_setters-f9ef9b3748a9c563.so usr/lib/libzerofrom_derive-6b32d288f5ca13aa.so usr/lib/librustc_fluent_macro-d88e97481e2e161a.so usr/lib/librustc_macros-180b779bef0b102e.so usr/lib/libtest-fcc98fc5a455681f.so usr/lib/libproc_macro_hack-33efa3691d8bbd1e.so usr/lib/libtracing_attributes-90ce0017b00f8dc4.so usr/lib/libunic_langid_macros_impl-bec054d18e5217c1.so usr/lib/libicu_provider_macros-dc7d00b284aebf6e.so usr/lib/librustc_driver-0ab633b096e08f64.so usr/lib/libderive_more-5fdf46b5cc1765ea.so usr/lib/libstd-36ff2a48d2e47cba.so usr/lib/rustlib/components usr/lib/rustlib/rust-installer-version usr/lib/rustlib/etc/lldb_providers.py usr/lib/rustlib/etc/gdb_providers.py usr/lib/rustlib/etc/gdb_load_rust_pretty_printers.py usr/lib/rustlib/etc/lldb_lookup.py usr/lib/rustlib/etc/lldb_commands usr/lib/rustlib/etc/gdb_lookup.py usr/lib/rustlib/etc/rust_types.py usr/lib/rustlib/aarch64-poky-linux-gnu/target.json usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libobject-ae20f034dd78a1d9.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcore-bf2ad8fe161cc5ce.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libhashbrown-205b68fcc37c2381.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_core-374238408188b126.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libadler-ab7de0f8e00aea75.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libaddr2line-f2f774ad0afdb07e.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_alloc-812290aca5e54ee3.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgetopts-f43d9ca2b0d8be34.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-fcc98fc5a455681f.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-36ff2a48d2e47cba.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcompiler_builtins-be3e88e50773698b.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_demangle-66bb94200abbeb01.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libminiz_oxide-7d7e02856b11a629.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libproc_macro-9faaa25208071125.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_unwind-608f3047a044e7ed.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_abort-c63a624f85ec8c6c.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_std-20a0ea6e6c940bee.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libsysroot-6db5455eb4003a32.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liballoc-5f8d330d7e8a9db6.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcfg_if-0d301611ad96b49f.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunicode_width-b71ee45ca54652d6.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-fcc98fc5a455681f.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libmemchr-86b8719098b3e8f0.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd_detect-0d7eb295964402bc.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liblibc-dec7bf00879e046b.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgimli-df49f1625e8c492c.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-36ff2a48d2e47cba.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunwind-f2e67b9b14f7fbda.rlib usr/bin/rustc usr/bin/rust-gdb usr/bin/rust-lldb usr/bin/rust-gdbgui usr/bin/cargo-fmt https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/8129/steps/15/logs/stdio qemuarm64-armhost ubuntu2204-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7295/steps/15/logs/stdio qemuarm64-armhost ubuntu2204-arm-1 scarthgap: https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8857/steps/18/logs/stdio pkgman-non-rpm opensuse154-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/42/builds/8885/steps/12/logs/stdio qemu-arm64 alma9-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/8270/steps/15/logs/stdio qemu-arm64-armhost ubuntu2204-arm-1 scarthgap: https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8870/steps/18/logs/stdio pkgman-non-rpm opensuse154-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/42/builds/8898/steps/12/logs/stdio qemuarm64 alma9-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/8283/steps/16/logs/stdio qemuarm64-armhost ubuntu1804-arm-1 I have reproduced this. The filenames differ depending on whether the build host is arm or x86. If packagedata sstate comes from arm and package sstate from x86, the reported error will occur. I'm going to look into how the hash part is formed and how the build host architecture leaks into it (on monday). Fixed by Alex K's x86, arm fix: https://git.yoctoproject.org/poky/commit/?id=d419566eda490870a51fff5b94834d0564718e10 Occurring again on scarthgap, which does have the fix referenced above. https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/885 qemuarm64-armhost ubuntu2004-vk-1 That patch on its own is not going to fix the issue. You also need to revert scarthgap-only 6ced2e7ca3b rust: Add new varaible RUST_ENABLE_EXTRA_TOOLS and then backport from master 3f69d525d81 rust: build the default set of tools a7bf118441d rust: use rust-snapshot binaries only in rust-native 8240d506fc1 rust: correctly link rust-snapshot into build/stage0 Fixed by backporting the commits suggested above. |