Bug 15185 - AB-INT: rust do_create_spdx failure
Summary: AB-INT: rust do_create_spdx failure
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: devtools / tool chain (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 5.1
Assignee: Steve Sakoman
QA Contact:
URL:
Whiteboard: AB-INT
Depends on:
Blocks:
 
Reported: 2023-08-10 14:20 UTC by Alexandre Belloni
Modified: 2025-01-30 15:26 UTC (History)
11 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandre Belloni 2023-08-10 14:20:45 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/6934/steps/16/logs/stdio

ERROR: rust-1.70.0-r0 do_create_spdx: No package file found for /usr/lib/libchalk_derive-f4d6e50ab3565138.so

qemuarm64-armhost ubuntu1804-arm-1
Comment 2 Alexandre Belloni 2023-09-07 21:19:01 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7055/steps/16/logs/stdio

qemuarm64-armhost ubuntu1804-arm-1
Comment 4 Alexandre Belloni 2023-09-07 21:41:16 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7059/steps/16/logs/stdio

qemuarm64-armhost ubuntu1804-arm-1
Comment 6 Alexandre Belloni 2023-09-07 22:00:06 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7053/steps/15/logs/stdio

qemuarm64-armhost ubuntu2204-arm-1
Comment 7 Joshua Watt 2023-09-28 14:43:21 UTC 
This is caused by rust not building reproducibly in a problematic way in that some of the files it generates have a hash(?) in the file name. This means that each time they build, the file names change, which doesn't play nice with hash equivalence. As such, the specific fix for rust is https://bugzilla.yoctoproject.org/show_bug.cgi?id=14875 but we will also work on being able to exclude recipes from hash equivalence so this can stop holding up the autobuilder.
Comment 9 Richard Purdie 2023-10-05 13:33:49 UTC 
rust-1.70.0-r0 do_create_spdx: No package file found for /usr/lib/libchalk_derive-f4d6e50ab3565138.so in rust; 

SPDX found: usr/bin/rust-gdbgui usr/bin/rust-lldb usr/bin/rustdoc usr/bin/rustc usr/bin/cargo-fmt usr/bin/rust-gdb usr/libexec/rust-analyzer-proc-macro-srv usr/lib/libchalk_derive-adea65fd7ba2b9ed.so usr/lib/libtracing_attributes-fb18d423158cea89.so usr/lib/libyoke_derive-f91e34aa2c00164f.so usr/lib/libstd-bfd33050193f03d7.so usr/lib/libzerovec_derive-e2df2cd6f18530b4.so usr/lib/libdisplaydoc-7bd398277a9b52e3.so usr/lib/libcstr-c286151fc700d1e1.so usr/lib/libzerofrom_derive-916935233ad0caa5.so usr/lib/libtest-4a600a7f6843f3ba.so usr/lib/libicu_provider_macros-32d936faa80a1e84.so usr/lib/libthiserror_impl-33951919b52eced5.so usr/lib/librustc_driver-bd5db83498eeda92.so usr/lib/libunic_langid_macros_impl-0b5561affe3c001c.so usr/lib/libderive_more-19f210d5d21a6023.so usr/lib/libserde_derive-8dcaff1f6d13132f.so usr/lib/libproc_macro_hack-190cbac30d726747.so usr/lib/librustc_macros-e1ad0b0b41d051ec.so usr/lib/rustlib/rust-installer-version usr/lib/rustlib/components usr/lib/rustlib/etc/lldb_lookup.py usr/lib/rustlib/etc/gdb_lookup.py usr/lib/rustlib/etc/gdb_providers.py usr/lib/rustlib/etc/lldb_commands usr/lib/rustlib/etc/lldb_providers.py usr/lib/rustlib/etc/gdb_load_rust_pretty_printers.py usr/lib/rustlib/etc/rust_types.py usr/lib/rustlib/aarch64-poky-linux-gnu/target.json usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libprofiler_builtins-a8e4cb8875b8d3f5.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liballoc-6fa5ed2e6c0c88b5.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunicode_width-f97ea3f94b4a12db.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-bfd33050193f03d7.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_alloc-bb49f5c65d87273f.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgimli-3c025098a90bcde2.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_demangle-26e850066ede46fe.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_std-aac95da1b171f6d3.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libproc_macro-14cccdea1edb1998.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgetopts-c19745e74c103616.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libaddr2line-977f7bcf59de4701.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcfg_if-bd34e40c3cd07526.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcompiler_builtins-7ef113061109fd52.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-bfd33050193f03d7.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-4a600a7f6843f3ba.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_core-622605243f47e028.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-4a600a7f6843f3ba.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libminiz_oxide-35a2854f0dde1078.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libadler-dd909c85ea2b1df8.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcore-16d28e29ee3b6019.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libhashbrown-abea5d3d8d653ad8.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libmemchr-11e7da57dc06724d.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libobject-d0f8b33da5222583.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_abort-2f492bb9c6c31a4e.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd_detect-670836d512ce2d98.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_unwind-82ed36a7727c9107.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liblibc-c3f4600779f1d1bc.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunwind-f8f7739ebf0d332e.rlib
Comment 10 Alexandre Belloni 2023-10-05 21:36:53 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7046/steps/15/logs/stdio

qemuarm64-armhost ubuntu2204-arm-1
Comment 11 Luca Ceresoli 2023-10-24 15:34:43 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7377/steps/15/logs/stdio

qemuarm64-armhost on ubuntu2204-arm-1
Comment 12 Alexandre Belloni 2023-12-11 17:00:03 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8232/steps/17/logs/stdio

pkgman-non-rpm fedora38-ty-6
Comment 13 Alexandre Belloni 2023-12-11 23:06:33 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8068/steps/17/logs/stdio

pkgman-non-rpm fedora38-ty-6
Comment 14 Alexandre Belloni 2023-12-11 23:08:57 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8061/steps/17/logs/stdio

pkgman-non-rpm fedora38-ty-2
Comment 15 Alexandre Belloni 2023-12-11 23:44:59 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/7937/steps/18/logs/stdio

pkgman-non-rpm opensuse154-ty-3
Comment 16 Alexandre Belloni 2023-12-14 23:19:54 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8189/steps/17/logs/stdio

pkgman-non-rpm fedora38-ty-2
Comment 18 Alexandre Belloni 2023-12-17 00:00:39 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/76/builds/8018/steps/18/logs/stdio

pkgman-non-rpm opensuse153-ty-1
Comment 19 Alexandre Belloni 2024-01-17 15:43:49 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7016/steps/15/logs/stdio

qemuarm64-armhost ubuntu2204-arm-1
Comment 21 Alexandre Belloni 2024-04-04 21:21:18 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/8169/steps/15/logs/errors

qemuarm64-armhost ubuntu2204-arm-1


The lib name changed:

ERROR: rust-1.75.0-r0 do_create_spdx: No package file found for /usr/lib/libcstr-c8db9f0ec9917268.so in rust; SPDX found: usr/lib/libyoke_derive-25a214f8b8d74016.so usr/lib/libthiserror_core_impl-38cf786ec3162cdd.so usr/lib/libthiserror_impl-d977ab854f506513.so usr/lib/libdarling_macro-a65409ac38dbfc55.so usr/lib/libcstr-2811f578aee286ce.so usr/lib/libzerovec_derive-94666b998fff5f11.so usr/lib/libdisplaydoc-33439fe413a96058.so usr/lib/libserde_derive-369aa83e6b6a0b1f.so usr/lib/libderivative-5df6e2c6e981324e.so usr/lib/libderive_setters-f9ef9b3748a9c563.so usr/lib/libzerofrom_derive-6b32d288f5ca13aa.so usr/lib/librustc_fluent_macro-d88e97481e2e161a.so usr/lib/librustc_macros-180b779bef0b102e.so usr/lib/libtest-fcc98fc5a455681f.so usr/lib/libproc_macro_hack-33efa3691d8bbd1e.so usr/lib/libtracing_attributes-90ce0017b00f8dc4.so usr/lib/libunic_langid_macros_impl-bec054d18e5217c1.so usr/lib/libicu_provider_macros-dc7d00b284aebf6e.so usr/lib/librustc_driver-0ab633b096e08f64.so usr/lib/libderive_more-5fdf46b5cc1765ea.so usr/lib/libstd-36ff2a48d2e47cba.so usr/lib/rustlib/components usr/lib/rustlib/rust-installer-version usr/lib/rustlib/etc/lldb_providers.py usr/lib/rustlib/etc/gdb_providers.py usr/lib/rustlib/etc/gdb_load_rust_pretty_printers.py usr/lib/rustlib/etc/lldb_lookup.py usr/lib/rustlib/etc/lldb_commands usr/lib/rustlib/etc/gdb_lookup.py usr/lib/rustlib/etc/rust_types.py usr/lib/rustlib/aarch64-poky-linux-gnu/target.json usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libobject-ae20f034dd78a1d9.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcore-bf2ad8fe161cc5ce.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libhashbrown-205b68fcc37c2381.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_core-374238408188b126.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libadler-ab7de0f8e00aea75.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libaddr2line-f2f774ad0afdb07e.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_alloc-812290aca5e54ee3.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgetopts-f43d9ca2b0d8be34.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-fcc98fc5a455681f.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-36ff2a48d2e47cba.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcompiler_builtins-be3e88e50773698b.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_demangle-66bb94200abbeb01.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libminiz_oxide-7d7e02856b11a629.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libproc_macro-9faaa25208071125.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_unwind-608f3047a044e7ed.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libpanic_abort-c63a624f85ec8c6c.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/librustc_std_workspace_std-20a0ea6e6c940bee.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libsysroot-6db5455eb4003a32.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liballoc-5f8d330d7e8a9db6.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libcfg_if-0d301611ad96b49f.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunicode_width-b71ee45ca54652d6.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libtest-fcc98fc5a455681f.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libmemchr-86b8719098b3e8f0.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd_detect-0d7eb295964402bc.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/liblibc-dec7bf00879e046b.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libgimli-df49f1625e8c492c.rlib usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libstd-36ff2a48d2e47cba.so usr/lib/rustlib/aarch64-poky-linux-gnu/lib/libunwind-f2e67b9b14f7fbda.rlib usr/bin/rustc usr/bin/rust-gdb usr/bin/rust-lldb usr/bin/rust-gdbgui usr/bin/cargo-fmt
Comment 22 Alexandre Belloni 2024-04-04 21:31:40 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/8129/steps/15/logs/stdio

qemuarm64-armhost ubuntu2204-arm-1
Comment 23 Alexandre Belloni 2024-04-05 17:20:52 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/7295/steps/15/logs/stdio

qemuarm64-armhost ubuntu2204-arm-1
Comment 26 Alexander Kanavin 2024-05-10 17:54:19 UTC 
I have reproduced this. The filenames differ depending on whether the build host is arm or x86. If packagedata sstate comes from arm and package sstate from x86, the reported error will occur.

I'm going to look into how the hash part is formed and how the build host architecture leaks into it (on monday).
Comment 27 Randy MacLeod 2024-06-06 15:03:19 UTC 
Fixed by Alex K's x86, arm fix:

https://git.yoctoproject.org/poky/commit/?id=d419566eda490870a51fff5b94834d0564718e10
Comment 28 Steve Sakoman 2025-01-25 20:31:13 UTC 
Occurring again on scarthgap, which does have the fix referenced above.

https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/885

qemuarm64-armhost ubuntu2004-vk-1
Comment 29 Alexander Kanavin 2025-01-25 21:12:30 UTC 
That patch on its own is not going to fix the issue. You also need to revert scarthgap-only

6ced2e7ca3b rust: Add new varaible RUST_ENABLE_EXTRA_TOOLS

and then backport from master

3f69d525d81 rust: build the default set of tools
a7bf118441d rust: use rust-snapshot binaries only in rust-native
8240d506fc1 rust: correctly link rust-snapshot into build/stage0
Comment 30 Steve Sakoman 2025-01-30 15:26:21 UTC 
Fixed by backporting the commits suggested above.