*** Bug 15847 has been marked as a duplicate of this bug. ***

Inside my KAS container, on an x86-64 host, I was about to build an install without any errors.

$ bitbake core-image-sato -c populate_sdk_ext
Loading cache: 100% |                                                                                                                  | ETA:  --:--:--
Loaded 0 entries from dependency cache.
Parsing recipes: 100% |#################################################################################################################| Time: 0:00:12
Parsing of 1003 .bb files complete (0 cached, 1003 parsed). 1989 targets, 124 skipped, 0 masked, 0 errors.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "2.12.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "debian-12"
TARGET_SYS           = "aarch64-poky-linux"
MACHINE              = "qemuarm64"
DISTRO               = "poky"
DISTRO_VERSION       = "5.2"
TUNE_FEATURES        = "aarch64 crc cortexa57"
TARGET_FPU           = ""
meta-arm
meta-arm-bsp
meta-arm-toolchain   = "HEAD:3d3b28ee73e7a7a8b0a477dd921d7403dd4eb742"
meta
meta-poky            = "walnascar:9b96fdbb0cab02f4a6180e812b02bc9d4c41b1a5"

NOTE: Fetching uninative binary shim http://downloads.yoctoproject.org/releases/uninative/4.7/x86_64-nativesdk-libc-4.7.tar.xz;sha256sum=5800d4e9a129d1be09cf548918d25f74e91a7c1193ae5239d5b0c9246c486d2c (will check PREMIRRORS first)
Sstate summary: Wanted 5114 Local 0 Mirrors 0 Missed 5114 Current 0 (0% match, 0% complete)#################################            | ETA:  0:00:00
Initialising tasks: 100% |##############################################################################################################| Time: 0:00:08
NOTE: Executing Tasks
WARNING: libatomic-ops-7.8.2-r0 do_fetch: Failed to fetch URL https://github.com/ivmai/libatomic_ops/releases/download/v7.8.2/libatomic_ops-7.8.2.tar.gz, attempting MIRRORS if available
NOTE: Tasks Summary: Attempted 10187 tasks of which 0 didn't need to be rerun and all succeeded.

Summary: There was 1 WARNING message.

$ ./tmp/deploy/sdk/poky-glibc-x86_64-core-image-sato-cortexa57-qemuarm64-toolchain-ext-5.2.sh
Poky (Yocto Project Reference Distro) Extensible SDK installer version 5.2
==========================================================================
Enter target directory for SDK (default: ~/poky_sdk):
You are about to install the SDK to "/builder/poky_sdk". Proceed [Y/n]?
Extracting SDK.....................................................................................................................................................done
Setting it up...
Extracting buildtools...
Preparing build system...
WARNING: You are using a local hash equivalence server but have configured an sstate mirror. This will likely mean no sstate will match from the mirror. You may wish to disable the hash equivalence use (BB_HASHSERVE), or use a hash equivalence server alongside the sstate mirror.
Loading cache: 100% |                                                                                                                  | ETA:  --:--:--
Parsing recipes: 100% |#################################################################################################################| Time: 0:00:17
Checking sstate mirror object availability: 100% |######################################################################################| Time: 0:00:02
NOTE: Reconnecting to bitbake server...
NOTE: Retrying server connection (#1)... (17:39:30.916295)
WARNING: You are using a local hash equivalence server but have configured an sstate mirror. This will likely mean no sstate will match from the mirror. You may wish to disable the hash equivalence use (BB_HASHSERVE), or use a hash equivalence server alongside the sstate mirror.
Loading cache: 100% |                                                                                                                  | ETA:  --:--:--
Parsing recipes: 100% |#################################################################################################################| Time: 0:00:14
Initialising tasks: 100% |##############################################################################################################| Time: 0:00:00
NOTE: Reconnecting to bitbake server...
NOTE: Retrying server connection (#1)... (17:39:51.732974)
WARNING: You are using a local hash equivalence server but have configured an sstate mirror. This will likely mean no sstate will match from the mirror. You may wish to disable the hash equivalence use (BB_HASHSERVE), or use a hash equivalence server alongside the sstate mirror.
Loading cache: 100% |###################################################################################################################| Time: 0:00:01
Initialising tasks: 100% |##############################################################################################################| Time: 0:00:00
done
SDK has been successfully set up and is ready to be used.
Each time you wish to use the SDK in a new shell session, you need to source the environment setup script e.g.
 $ . /builder/poky_sdk/environment-setup-cortexa57-poky-linux

*** Bug 15726 has been marked as a duplicate of this bug. ***

Patch v4 sent here:
[PATCH v4 1/2] create-spdx-image-3.0: Image SPDX/SBOM tasks are retained for eSDK installation https://lists.openembedded.org/g/openembedded-core/message/227739
[PATCH v4 2/2] populate_sdk_ext: keep SDK_TARGETS so SPDX/SBOM tasks remain in locked sigs https://lists.openembedded.org/g/openembedded-core/message/227740
(not merged yet)

With master as of last night (6ce19709f7835ee5cd7915e181f89397975236c8) and a clean build tree, installing the non-minimal eSDK still fails:

ERROR: Task gcc-source-15.2.0.do_fetch attempted to execute unexpectedly
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/libgcc-initial_15.2.bb:do_populate_sysroot, unihash 9bdc5ce5d355161317a7256892eabce9ebb64551f9c30c0dd077a290201a31a4, taskhash 9bdc5ce5d355161317a7256892eabce9ebb64551f9c30c0dd077a290201a31a4
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_image_spdx, unihash 5b7f7bbb1577360f50a2cfd2ba19c5bbaa6d2db078df81b0d6e9cbf2c0080b2c, taskhash 5b7f7bbb1577360f50a2cfd2ba19c5bbaa6d2db078df81b0d6e9cbf2c0080b2c
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/libgcc-initial_15.2.bb:do_deploy_source_date_epoch, unihash 810c5a4f4323c3337b5bbec50790d91f895c0d15257dc0193007859ae0294f68, taskhash 810c5a4f4323c3337b5bbec50790d91f895c0d15257dc0193007859ae0294f68
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_package_spdx, unihash 2b86f21afbd391985954049f321ad4b73ea6027eccfdd23b3f9e2050bce3a348, taskhash 2b86f21afbd391985954049f321ad4b73ea6027eccfdd23b3f9e2050bce3a348
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/libgcc-initial_15.2.bb:do_create_spdx, unihash 0be6064577e986eb7ebf06cb34b3b06f52d54aa2cd0a7ed9f62dfd9049a0358a, taskhash 0be6064577e986eb7ebf06cb34b3b06f52d54aa2cd0a7ed9f62dfd9049a0358a
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/gcc-source_15.2.bb:do_deploy_source_date_epoch, unihash 0e485c96370c495645de362caef53153f9592c263fee45fa63b0576b51ab4509, taskhash 0e485c96370c495645de362caef53153f9592c263fee45fa63b0576b51ab4509
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_spdx, unihash f8b14e1b6bd48cb2a1e17a88ed975ba8abe8e2f612d4aba38de29295dca3effe, taskhash f8b14e1b6bd48cb2a1e17a88ed975ba8abe8e2f612d4aba38de29295dca3effe
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/gcc-cross_15.2.bb:do_gcc_stash_builddir, unihash de889f1316d3528fe49f95ac9ebab7b2c0b32357bea360919a2fae0b4419664c, taskhash de889f1316d3528fe49f95ac9ebab7b2c0b32357bea360919a2fae0b4419664c
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_deploy_source_date_epoch, unihash 51a6c907fe151cf0ae74eb35edfbb66b26852ecdbbe440a3b9ff2a2d3ec54fad, taskhash 51a6c907fe151cf0ae74eb35edfbb66b26852ecdbbe440a3b9ff2a2d3ec54fad
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/gcc-cross_15.2.bb:do_deploy_source_date_epoch, unihash 63960626911c242a6136f3ebd2fbfc7f40208b14d66eb8b6e6c3e08571990a86, taskhash 63960626911c242a6136f3ebd2fbfc7f40208b14d66eb8b6e6c3e08571990a86
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_image_sbom_spdx, unihash ed4d787d16e528feae03f38804f5796a3f54ce26ef590350decbab5f9bd6d3b4, taskhash ed4d787d16e528feae03f38804f5796a3f54ce26ef590350decbab5f9bd6d3b4
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_rootfs_spdx, unihash d88fe8223382bd1e2b5df981a12ac09a24cef53f9a0cb369f290e662b2af582b, taskhash d88fe8223382bd1e2b5df981a12ac09a24cef53f9a0cb369f290e662b2af582b
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_image_complete, unihash 60e762d1894192b99a57dc8e0542924d08b01e4e098145e22f89f258c7d46d98, taskhash 60e762d1894192b99a57dc8e0542924d08b01e4e098145e22f89f258c7d46d98
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_recipe_qa, unihash a1b05286ef286348c7bf44a5693e9455974e3951069be725ccdc5439b37a5de8, taskhash a1b05286ef286348c7bf44a5693e9455974e3951069be725ccdc5439b37a5de8
Task /home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_image_qa, unihash 1ac806282a2eb0e13c8d8e823f1132c828cc9c41c7db1d2f3f2b9db96cc5bd40, taskhash 1ac806282a2eb0e13c8d8e823f1132c828cc9c41c7db1d2f3f2b9db96cc5bd40
This is usually due to missing setscene tasks. Those missing in this build were: {'/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_image_sbom_spdx',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_image_spdx',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_package_spdx',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_rootfs_spdx',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_create_spdx',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_deploy_source_date_epoch',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_image_complete',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_image_qa',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-core/images/core-image-base.bb:do_recipe_qa',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/gcc-cross_15.2.bb:do_deploy_source_date_epoch',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/gcc-cross_15.2.bb:do_gcc_stash_builddir',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/gcc-source_15.2.bb:do_deploy_source_date_epoch',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/libgcc-initial_15.2.bb:do_create_spdx',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/libgcc-initial_15.2.bb:do_deploy_source_date_epoch',
 '/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/libgcc-initial_15.2.bb:do_populate_sysroot'}
ERROR: Task (/home/rosbur01/nodistro_sdk/layers/openembedded-core/meta/recipes-devtools/gcc/gcc-source_15.2.bb:do_fetch) failed with exit code 'setscene ignore_tasks'

Bump to 6.1-M1.

Sunil,
 Can you reproduce the problem?
 Have you looked at Yoann's patch set ?

Hi Randy,
Yes, reproduced on current master - same failure Ross reported in Comment #5.

Going through Jayasurya's v4 series now [1][2].
His approach looks reasonable, but I want to understand the SPDX 3.0 / locked-sigs interaction properly before resubmitting the patch to the mailing list.

I am planning to rebase on master and post v5 with a selftest added to oeSDKExtSelfTest (meta/lib/oeqa/selftest/cases/esdk.py).

[1] 
 https://lists.openembedded.org/g/openembedded-core/message/227739
[2]
 https://lists.openembedded.org/g/openembedded-core/message/227740

The existing oeSDKExtSelfTest.setUpClass already builds and installs a full eSDK, which exercises this code path.

Rebased on master and sent the patch to oe-core ML for review:

https://lists.openembedded.org/g/openembedded-core/message/236092

https://lists.openembedded.org/g/openembedded-core/message/236091

https://lists.openembedded.org/g/openembedded-core/message/236093

Hi Sunil/Ross,

Could one of you confirm how to reproduce this please? I've tried in a completely clean build directory and I can't make it fail as reported. I'm trying:

$ bitbake-setup init

Selecting:
3. poky-master
1. machine/qemux86-64
1. distro/poky  

$ . bitbake-builds/poky-master/build/init-build-en
Set DL_DIR in bitbake-builds/site.conf
$ bitbake core-image-sato -c populate_sdk_ext

Add IMAGE_CLASSES += "testimage testsdk" to local.conf

$ bitbake core-image-sato -c testsdkext

and it basically worked (failures fetching in kernel-modules and with maturnin missing but esdk extracted/ran fine).

Hi Richard,

Thanks for trying this. I'll re-run it on current master today and get back to you with the exact steps I used and whether it still fails on my side.

If it passes now I'll dig into what changed recently and update the bug.

Re: bug #15726, I just disabled my do_image_complete[vardeps] += "BBLAYERS" workaround in wrynose, and the eSDK installed without error.  So it appears fixed for me now as well.

Hi Richard,

Quick update from my side. I can confirm what you saw in comment 10: on
current master and on wrynose the full core-image-sato eSDK installs fine
for me now. Both branches already have the bitbake change "data: fix issue
with varflag exclusion":

master: https://git.openembedded.org/bitbake/commit/?id=8ab71d0ce302521da6a7e18c887cd85d9a94e8ee

2.18:   https://git.openembedded.org/bitbake/commit/?h=2.18&id=ddb97b7c5e40bf4f375f2dcf46ceb9f36e7b1584

2.8:    https://git.openembedded.org/bitbake/commit/?h=2.8&id=0880963fea4d91a034e4a6e007d23f98658ab986

scarthgap is fine as well (SPDX 2.2 by default, and 2.8 has the backport).

The only place I can still reproduce the problem is walnascar, which never
got that commit. With the walnascar tip, a cold build with SSTATE_MIRRORS and
BB_HASHSERVE_UPSTREAM empty, and the install going into an empty directory,
I get the original error:

  ERROR: Task gcc-source-14.3.0.do_fetch attempted to execute unexpectedly
  Sstate summary: Wanted 4640 Local 3741 Mirrors 0 Missed 899

I then cherry-picked only that one bitbake commit onto 2.12 (the 2.8
backport, 0880963fe) and rebuilt from a fresh clone with the same settings.
The eSDK now installs successfully:

  Sstate summary: Wanted 0 Local 0 Mirrors 0 Missed 0

So the fix is in place on every supported branch, and the one-line
cherry-pick is all an EOL branch needs.

Given that, would you be okay with closing this one as RESOLVED FIXED? 

Thanks,
Sunil