Created attachment 4762 [details] Error log in some Ubuntu 18 container: 1) bitbake core-image-sato-sdk -c populate_sdk_ext && bitbake buildtools-extended-tarball on a host (Ubuntu 20, Ubuntu16) 2) I try to install buildtools-extended-tarball and the eSDK 3) installing buildtools-extended-tarball works 130 student@e450-4:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ sudo rm -rf /opt/resy/3.2.66 student@e450-4:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ ./x86_64-buildtools-extended-nativesdk-standalone-3.2.66.sh Extended Build tools installer version 3.2.66 ============================================= Enter target directory for SDK (default: /opt/resy/3.2.66): You are about to install the SDK to "/home/opt/resy/3.2.66". Proceed [Y/n]? Y Extracting SDK...................................done Setting it up...done SDK has been successfully set up and is ready to be used. Each time you wish to use the SDK in a new shell session, you need to source the environment setup script e.g. $ . /home/opt/resy/3.2.66/environment-setup-x86_64-resysdk-linux student@e450-4:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ source /home/opt/resy/3.2.66/environment-setup-x86_64-resysdk-linux student@e450-4:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ ./resy-glibc-x86_64-core-image-sato-sdk-armv7at2hf-vfp-multi-v7-ml-toolchain-ext-3.2.66.sh Resy (Reliable Embedded Systems Reference Distro) Extensible SDK installer version 3.2.66 ========================================================================================= Enter target directory for SDK (default: ~/resy_sdk): The directory "/home/student/resy_sdk" already contains a SDK for this architecture. If you continue, existing files will be overwritten! Proceed [y/N]? ^C 130 student@e450-4:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ rm -rf /home/student/resy_sdk student@e450-4:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ ./resy-glibc-x86_64-core-image-sato-sdk-armv7at2hf-vfp-multi-v7-ml-toolchain-ext-3.2.66.sh Resy (Reliable Embedded Systems Reference Distro) Extensible SDK installer version 3.2.66 ========================================================================================= Enter target directory for SDK (default: ~/resy_sdk): You are about to install the SDK to "/home/student/resy_sdk". Proceed [Y/n]? Y Extracting SDK........................................................................................................................................................................................done Setting it up... Extracting buildtools... Preparing build system... Loading cache: 100% | | ETA: --:--:-- Parsing recipes: 100% |########################################################################################################################################################| Time: 0:01:41 Initialising tasks: 100% |#####################################################################################################################################################| Time: 0:00:06 Checking sstate mirror object availability: 100% |#############################################################################################################################| Time: 0:00:00 ERROR: Task pseudo-native.do_fetch attempted to execute unexpectedly !!! Please note, that if I do the same thing in a container, which is similar to my Yocto build container it works. !!!
Is this reliably reproducible?
At least in my environment, it seems to be reliably reproducible on different machines. I am currently building/testing with gatesgarth latest and master latest plus my layers. The workaround I am testing at the moment is to install the eSDK via a docker sdk container. Those missing in this build were: {'/home/student/resy_sdk/layers/meta-multi-v7-ml-bsp/recipes-kernel/crash-small/crash-small_7.2.5.bb:do_package', '/home/student/resy_sdk/layers/meta-multi-v7-ml-bsp/recipes-kernel/linux/linux-yocto-custom_5.10.2.bb:do_package', '/home/student/resy_sdk/layers/meta-multi-v7-ml-bsp/recipes-kernel/linux/linux-yocto-custom_5.10.2.bb:do_shared_workdir', '/home/student/resy_sdk/layers/meta-openembedded/meta-networking/recipes-connectivity/mosquitto/mosquitto_1.6.12.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-networking/recipes-connectivity/mosquitto/mosquitto_1.6.12.bb:do_populate_sysroot', '/home/student/resy_sdk/layers/meta-openembedded/meta-networking/recipes-support/iftop/iftop_1.0pre4.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-networking/recipes-support/ntp/ntp_4.2.8p15.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-networking/recipes-support/ntp/ntp_4.2.8p15.bb:do_populate_sysroot', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/dynamic-layers/meta-python/recipes-support/smem/smem_1.5.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/cpuburn/cpuburn-arm_git.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/iozone3/iozone3_490.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/iperf2/iperf2_2.0.13.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/iperf3/iperf3_3.9.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/libhugetlbfs/libhugetlbfs_git.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/memtester/memtester_4.5.0.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/nbench-byte/nbench-byte_2.2.3.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/phoronix-test-suite/phoronix-test-suite_9.2.1.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-benchmark/tinymembench/tinymembench_git.bb:do_package', '/home/student/resy_sdk/layers/meta-openembedded/meta-oe/recipes-bsp/lm_sensors/lmsensors-config_1.0.bb:do_package', ...
with master latest the same problem, but I now see also these warnings when I try to install the eSDK: WARNING: The base-files:do_install sig is computed to be 5ed8a324beb483ca425c7ef31e2c215251bb58e2ea86926edf78c1b2c5b7c62d, but the sig is locked to a6d3d011569b39b1bf7175fa3ed4cf9728e6242f007899582b19979d2a49e328 in SIGGEN_LOCKEDSIGS_t-multi-v7-ml The lsb-release:do_install sig is computed to be b2df10a10d10c63eba44e7520803d91d4d17d94d5dd86fb1f863d1e9b7ab653d, but the sig is locked to fa0b313f396dda3ee5057bbbf82b4c373d15d590faa86b39258b101b0cc7ed9c in SIGGEN_LOCKEDSIGS_t-armv7at2hf-vfp ./resy-glibc-x86_64-core-image-sato-sdk-armv7at2hf-vfp-multi-v7-ml-toolchain-ext-3.2+snapshot.sh Resy (Reliable Embedded Systems Reference Distro) Extensible SDK installer version 3.2+snapshot =============================================================================================== Enter target directory for SDK (default: ~/resy_sdk): You are about to install the SDK to "/home/student/resy_sdk". Proceed [Y/n]? Extracting SDK.................................................................................................................done Setting it up... Extracting buildtools... Preparing build system... Loading cache: 100% | | ETA: --:--:-- Parsing recipes: 100% |########################################################################################################################################################| Time: 0:01:52 Initialising tasks: 100% |#####################################################################################################################################################| Time: 0:00:05 Checking sstate mirror object availability: 100% |#############################################################################################################################| Time: 0:00:00 WARNING: The base-files:do_install sig is computed to be 5ed8a324beb483ca425c7ef31e2c215251bb58e2ea86926edf78c1b2c5b7c62d, but the sig is locked to a6d3d011569b39b1bf7175fa3ed4cf9728e6242f007899582b19979d2a49e328 in SIGGEN_LOCKEDSIGS_t-multi-v7-ml The lsb-release:do_install sig is computed to be b2df10a10d10c63eba44e7520803d91d4d17d94d5dd86fb1f863d1e9b7ab653d, but the sig is locked to fa0b313f396dda3ee5057bbbf82b4c373d15d590faa86b39258b101b0cc7ed9c in SIGGEN_LOCKEDSIGS_t-armv7at2hf-vfp ERROR: Task pseudo-native.do_fetch attempted to execute unexpectedly Task /home/student/resy_sdk/layers/poky-master/meta/recipes-extended/libarchive/libarchive_3.5.1.bb:do_package, unihash 66882f8abd924d8b81892b4a51cac4b4a7ffff36252ef49e2e49587b87771c01, taskhash 66882f8abd924d8b81892b4a51cac4b4a7ffff36252ef49e2e49587b87771c01 Task /home/student/resy_sdk/layers/poky-master/meta/recipes-graphics/freetype/freetype_2.10.4.bb:do_package, unihash 6f9eb744fd094f2f123af9e3b612b0a851e14ee9e5f880822f675ae4818aeb2f, taskhash 6f9eb744fd094f2f123af9e3b612b0a851e14ee9e5f880822f675ae4818aeb2f Task /home/student/resy_sdk/layers/poky-master/meta/recipes-connectivity/openssl/openssl_1.1.1i.bb:do_package, unihash 45d05cf8368dd69efa31c129623e8bd05e445e45238fb49377b768e5f3dc0430, taskhash 45d05cf8368dd69efa31c129623e8bd05e445e45238fb49377b768e5f3dc0430 Task /home/student/resy_sdk/layers/poky-master/meta/recipes-support/ca-certificates/ca-certificates_20200601.bb:do_package, unihash 47c22897a1b6928f66119c46aa9879127d3b2155922439ee3ba4be0e4276965e, taskhash 47c22897a1b6928f66119c46aa9879127d3b2155922439ee3ba4be0e4276965e ...
with gatesgarth latest same problem: $ . /home/opt/resy/3.2.1/environment-setup-x86_64-resysdk-linux student@e450-6:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ source /home/opt/resy/3.2.1/environment-setup-x86_64-resysdk-linux student@e450-6:/workdir/build/multi-v7-ml-debug-training/tmp/deploy/sdk⟫ ./resy-glibc-x86_64-core-image-sato-sdk-armv7at2hf-vfp-multi-v7-ml-toolchain-ext-3.2.1.sh Resy (Reliable Embedded Systems Reference Distro) Extensible SDK installer version 3.2.1 ======================================================================================== Enter target directory for SDK (default: ~/resy_sdk): You are about to install the SDK to "/home/student/resy_sdk". Proceed [Y/n]? Extracting SDK...............................................................................................................................................................................done Setting it up... Extracting buildtools... Preparing build system... Loading cache: 100% | | ETA: --:--:-- Parsing recipes: 100% |########################################################################################################################################################| Time: 0:01:27 Initialising tasks: 100% |#####################################################################################################################################################| Time: 0:00:05 Checking sstate mirror object availability: 100% |#############################################################################################################################| Time: 0:00:00 ERROR: Task pseudo-native.do_fetch attempted to execute unexpectedly Task /home/student/resy_sdk/layers/meta-openembedded/meta-networking/recipes-connectivity/mosquitto/mosquitto_1.6.12.bb:do_package, unihash 10ceb82f8320744721a10ebb6c24cb5ef43d152163ee8b224c6366d428d12700, taskhash 10ceb82f8320744721a10ebb6c24cb5ef43d152163ee8b224c6366d428d12700 Task /home/student/resy_sdk/layers/poky-training/meta/recipes-extended/lsb/lsb-release_1.4.bb:do_package, unihash d5bd584b6bc815ba216286bdbfd3cf4b3ad34d692cf23489d1011388319efe61, taskhash d5bd584b6bc815ba216286bdbfd3cf4b3ad34d692cf23489d1011388319efe61 Task /home/student/resy_sdk/layers/poky-training/meta/recipes-graphics/xorg-xserver/xserver-xorg_1.20.9.bb:do_package, unihash ece48684dede58423154d9d1da84d485675857e72fe6e46f94d7c7cac101dabd, taskhash ece48684dede58423154d9d1da84d485675857e72fe6e46f94d7c7cac101dabd Task /home/student/resy_sdk/layers/poky-training/meta/recipes-devtools/python/python3-pygobject_3.36.1.bb:do_package, unihash f9ed0b8eb6a64299a12f6c0b45e5939775f1910bae0215758db64ff2dcea95a9, taskhash f9ed0b8eb6a64299a12f6c0b45e5939775f1910bae0215758db64ff2dcea95a9 Task /home/student/resy_sdk/layers/poky-training/meta/recipes-graphics/wayland/mtdev_1.1.6.bb:do_package, unihash 2a4961f859260aa33dea066a9a5b26107a63fe6c7e583ccb870adf94ba16c5f1, taskhash 2a4961f859260aa33dea066a9a5b26107a63fe6c7e583ccb870adf94ba16c5f1 Task /home/student/resy_sdk/layers/poky-training/meta/recipes-core/sysvinit/sysvinit-inittab_2.88dsf.bb:do_package, unihash b0feef02554764e7d933f31b15f018465bfad326f1666cb273141885574e2f09, taskhash b0feef02554764e7d933f31b15f018465bfad326f1666cb273141885574e2f09
I'll try to see if only with poky I can reproduce the problem as well.
So I've got a testcase only with poky, where you should be able to reproduce the problem. = build container = (not sure this happens only if built from the container) From my poky build container[1] [1] reliableembeddedsystems/poky-container:2020-07-26-master-local-gcc-9-gui-ub18 1) setup cd into poky-master source oe-init-build-env /workdir/build/qemux86-64 See attachment for config files 2) bake bitbake core-image-sato-sdk -c populate_sdk_ext && bitbake buildtools-extended-tarball = host = ./x86_64-buildtools-extended-nativesdk-standalone-3.2+snapshot-b5e634644b69a968a93aad0dd0502cf479d3973a.sh Extended Build tools installer version 3.2+snapshot =================================================== Enter target directory for SDK (default: /opt/poky/3.2+snapshot): You are about to install the SDK to "/home/opt/resy/3.2+snapshot". Proceed [Y/n]? Y Extracting SDK...................................done Setting it up...done SDK has been successfully set up and is ready to be used. Each time you wish to use the SDK in a new shell session, you need to source the environment setup script e.g. $ . /home/opt/resy/3.2+snapshot/environment-setup-x86_64-pokysdk-linux student@e450-7:/workdir/build/qemux86-64/tmp/deploy/sdk⟫ source /home/opt/resy/3.2+snapshot/environment-setup-x86_64-pokysdk-linux student@e450-7:/workdir/build/qemux86-64/tmp/deploy/sdk⟫ ./poky-glibc-x86_64-core-image-sato-sdk-core2-64-qemux86-64-toolchain-ext-3.2+snapshot.sh Poky (Yocto Project Reference Distro) Extensible SDK installer version 3.2+snapshot =================================================================================== Enter target directory for SDK (default: ~/poky_sdk): You are about to install the SDK to "/home/student/poky_sdk". Proceed [Y/n]? ^C 130 student@e450-7:/workdir/build/qemux86-64/tmp/deploy/sdk⟫ rm -rf /home/student/poky_sdk student@e450-7:/workdir/build/qemux86-64/tmp/deploy/sdk⟫ ./poky-glibc-x86_64-core-image-sato-sdk-core2-64-qemux86-64-toolchain-ext-3.2+snapshot.sh Poky (Yocto Project Reference Distro) Extensible SDK installer version 3.2+snapshot =================================================================================== Enter target directory for SDK (default: ~/poky_sdk): You are about to install the SDK to "/home/student/poky_sdk". Proceed [Y/n]? Y Extracting SDK....................................................................................................done Setting it up... Extracting buildtools... Preparing build system... Loading cache: 100% | | ETA: --:--:-- Parsing recipes: 100% |########################################################################################################################################################| Time: 0:00:40 Initialising tasks: 100% |#####################################################################################################################################################| Time: 0:00:04 Checking sstate mirror object availability: 100% |#############################################################################################################################| Time: 0:00:00 WARNING: The base-files:do_install sig is computed to be 2a56c261ed0bbea90b58d1eb5d9f696a79770dfb4f75fe60f35a9cfa6fb48f63, but the sig is locked to edf7fc0e4b2eac09a51ce2462cf38de4d1037a34c1824974f704d53a99b5917a in SIGGEN_LOCKEDSIGS_t-qemux86-64 ERROR: Task pseudo-native.do_fetch attempted to execute unexpectedly Task /home/student/poky_sdk/layers/poky-master/meta/recipes-multimedia/speex/speex_1.2.0.bb:do_package, unihash ad6c35da188523b657f84faf546ddf881eec0c29f0359546a691a80032cb8c47, taskhash ad6c35da188523b657f84faf546ddf881eec0c29f0359546a691a80032cb8c47 Task /home/student/poky_sdk/layers/poky-master/meta/recipes-support/ca-certificates/ca-certificates_20200601.bb:do_package, unihash 945cc53e14b459a8c2907cd55244b4ea9cf6dc259bdf066af911144454e93971, taskhash 945cc53e14b459a8c2907cd55244b4ea9cf6dc259bdf066af911144454e93971 Task /home/student/poky_sdk/layers/poky-master/meta/recipes-support/fribidi/fribidi_1.0.10.bb:do_package, unihash b71c9eb962d081596613bdc3b261d136d3e014b5ec457788006b8ce3cc1f5cf9, taskhash b71c9eb962d081596613bdc3b261d136d3e014b5ec457788006b8ce3cc1f5cf9 Task /home/student/poky_sdk/layers/poky-master/meta/recipes-support/atk/at-spi2-atk_2
As a side note: If I install the eSDK in an sdk container it works in there, but not everything also works on the host. e.g. devtool does not work on the host. make, cmake, autotools cross compilation works from the host. This may be related to the fact that for some strange reasons when install the eSDK it resolves symlinks, which end up in the installed SDK. I mean: I install to /opt/resy/3.2.66 and so on On the host it's opt -> /datastore/opt so the eSDK resolved to /datastore/opt on the host and /opt in the container
Thanks for the info. We don't have anyone to handle this defect right now.
Just wanted to let you know that the bug persists with master/3.3.x I can install buildtools-extended-tarball, but not the extensible sdk, which might be a show stopper for people trying to use the extensible sdk.
It looks like this is the problem: https://bugzilla.yoctoproject.org/show_bug.cgi?id=14428
Robert, The issue you linked to in your last comment here has been fixed. Did it fix this issue too? If you could check and reply before Thursday April 14th, 2022, that would be good. -- Randy
looks like this was fixed with 3.4.x eSDK: cat /etc/issue Ubuntu 20.04.3 LTS \n \l /x86_64-buildtools-extended-nativesdk-standalone-3.4.66.sh Extended Build tools installer version 3.4.66 ============================================= Enter target directory for SDK (default: /opt/resy/3.4.66): /home/student/test//opt/resy/3.4.66 You are about to install the SDK to "/home/student/test/opt/resy/3.4.66". Proceed [Y/n]? Y Extracting SDK...................................done Setting it up...done SDK has been successfully set up and is ready to be used. Each time you wish to use the SDK in a new shell session, you need to source the environment setup script e.g. $ . /home/student/test/opt/resy/3.4.66/environment-setup-x86_64-resysdk-linux source /home/student/test/opt/resy/3.4.66/environment-setup-x86_64-resysdk-linux ./resy-glibc-x86_64-core-image-sato-sdk-armv7at2hf-neon-multi-v7-ml-toolchain-ext-3.4.66.sh Resy (Reliable Embedded Systems Reference Distro) Extensible SDK installer version 3.4.66 ========================================================================================= Enter target directory for SDK (default: ~/resy_sdk): /home/student/test/resy_sdk/3.4.66 You are about to install the SDK to "/home/student/test/resy_sdk/3.4.66". Proceed [Y/n]? Y Extracting SDK....................................................................................................................................................done Setting it up... Extracting buildtools... Preparing build system... NOTE: Started PRServer with DBfile: /home/student/test/resy_sdk/3.4.66/cache/prserv.sqlite3, Address: 127.0.0.1:37407, PID: 3705672 Loading cache: 100% | | ETA: --:--:-- Loaded 0 entries from dependency cache. NOTE: imported (fontconfig-2.13.1-r0,armv7at2hf-neon,d19438895cd4c349115d8c59c8fb586032e8736442e29ff5192d388c1ec27495,0)###################################################### | ETA: 0:00:00 NOTE: imported (nativesdk-kmod-29-r0,x86_64-nativesdk,d45dc800c3a3e686bb39aa05d968575fadfddea865ca4d63fe387bd78e0c0d06,0) NOTE: imported (python3-py-1.11.0-r0,armv7at2hf-neon,cc2e83c32a0dce9d9f2024b427893796ad86ae8328d188659c14eb32b6dbfd7f,0) ... NOTE: imported (iproute2-5.15.0-r0,armv7at2hf-neon,5dab23c2aa1b5b0fff157d64a4a7790b71f849a19dfeac2b8f80f6417d3e3e9a,0) NOTE: imported (libpthread-stubs-0.4-r0,armv7at2hf-neon,30afc8447743fda9016185138310b4905bf305dc0ca93a9c9a6a011ff4e708a3,0) Parsing recipes: 100% |########################################################################################################################################################| Time: 0:02:08 Parsing of 2516 .bb files complete (0 cached, 2516 parsed). 3893 targets, 197 skipped, 0 masked, 0 errors. Importing from file /home/student/test/resy_sdk/3.4.66/conf/prserv.inc succeeded! NOTE: Reconnecting to bitbake server... NOTE: Previous bitbake instance shutting down?, waiting to retry... NOTE: Retrying server connection (#1)... Loading cache: 100% | | ETA: --:--:-- Parsing recipes: 100% |########################################################################################################################################################| Time: 0:01:50 Initialising tasks: 100% |#####################################################################################################################################################| Time: 0:00:06 Checking sstate mirror object availability: 100% |#############################################################################################################################| Time: 0:00:03 Loading cache: 100% |##########################################################################################################################################################| Time: 0:00:00 Parsing recipes: 100% |########################################################################################################################################################| Time: 0:00:00 Initialising tasks: 100% |#####################################################################################################################################################| Time: 0:00:00 done SDK has been successfully set up and is ready to be used. Each time you wish to use the SDK in a new shell session, you need to source the environment setup script e.g. $ . /home/student/test/resy_sdk/3.4.66/environment-setup-armv7at2hf-neon-resy-linux-gnueabi
An example of something that we need to improve debugging on...
Build move to 5.0 -- ../Randy
Bulk move of 5.0 medium importance issues to 5.99. Move to 5.1 if you want to actively work on an issue.
Move to 5.99 since no one is actively working on this issue. Move to 5.x if you start on a task, please.
Comment 12 says it was fixed