Bug 14657

Summary:	AB-INT: SDK preparation failure: Task libgpg-error-native.do_fetch attempted to execute unexpectedly
Product:	[QA/Testing] Runtime Testing	Reporter:	Alexandre Belloni <alexandre.belloni>
Component:	testsdk	Assignee:	Unassigned <unassigned>
Status:	RESOLVED OBSOLETE	QA Contact:
Severity:	normal
Priority:	Medium	CC:	alexandre.belloni, luca.ceresoli, randy.macleod
Version:	4.0
Target Milestone:	4.1
Hardware:	x86
OS:	Multiple
Whiteboard:	AB-INT
OS type for building Yocto:	---	Type of Regression:	---
Verified:		Documentation change:	No (bug/feature does not impact docs)

Description Alexandre Belloni 2021-12-11 15:38:25 UTC

https://autobuilder.yoctoproject.org/typhoon/#/builders/80/builds/2681/steps/14/logs/stdio
oe-selftest-debian debian10-ty-1

2021-10-14 20:57:02,222 - oe-selftest - INFO - ERROR: setUpClass (eSDK.oeSDKExtSelfTest) [ (subunit.RemotedTestCase)
2021-10-14 20:57:02,222 - oe-selftest - INFO - ----------------------------------------------------------------------
2021-10-14 20:57:02,222 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-debian/build/meta/lib/oeqa/core/case.py", line 39, in _oeSetUpClass
    clss.setUpClassMethod()
  File "/home/pokybuild/yocto-worker/oe-selftest-debian/build/meta/lib/oeqa/selftest/cases/eSDK.py", line 88, in setUpClass
    runCmd("%s -y -d \"%s\"" % (cls.ext_sdk_path, cls.tmpdir_eSDKQA))
  File "/home/pokybuild/yocto-worker/oe-selftest-debian/build/meta/lib/oeqa/utils/commands.py", line 207, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
2021-10-14 20:31:15,322 - oe-selftest - INFO - VerifyManifest: doing bitbake core-image-minimal as a prerequisite of the test
AssertionError: Command '/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/deploy/sdk/poky-glibc-x86_64-core-image-minimal-core2-64-qemux86-64-toolchain-ext-3.4.sh -y -d "/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be"' returned non-zero exit status 1:
Poky (Yocto Project Reference Distro) Extensible SDK installer version 3.4
==========================================================================
You are about to install the SDK to "/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be". Proceed [Y/n]? Y
Extracting SDK...........done
Setting it up...
Extracting buildtools...
Preparing build system...
/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/bitbake/lib/pyinotify.py:55: DeprecationWarning: The asyncore module is deprecated. The recommended replacement is asyncio
  import asyncore
Loading cache...done.
Parsing recipes...done.
Initialising tasks...done.
Checking sstate mirror object availability...done.
ERROR: Task libgpg-error-native.do_fetch attempted to execute unexpectedly
Task virtual:native:/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/meta/recipes-support/libgpg-error/libgpg-error_1.42.bb:do_populate_sysroot, unihash 36851324e350268b8c921a1322b0bcaba56f9ab189e5bc13750c75db8678ec51, taskhash 36851324e350268b8c921a1322b0bcaba56f9ab189e5bc13750c75db8678ec51
Task virtual:native:/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/meta/recipes-support/libmicrohttpd/libmicrohttpd_0.9.73.bb:do_populate_sysroot, unihash 875ba43ed54fd236731b8e1947ba1a1be0570fc01dd7f49f6d61ff5a1f6bc591, taskhash 875ba43ed54fd236731b8e1947ba1a1be0570fc01dd7f49f6d61ff5a1f6bc591
Task virtual:native:/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/meta/recipes-support/libgpg-error/libgpg-error_1.42.bb:do_deploy_source_date_epoch, unihash 3aeefdb54b7c97b2db1f710478f14acc6c198fb7b375e6582db53824db988201, taskhash 3aeefdb54b7c97b2db1f710478f14acc6c198fb7b375e6582db53824db988201
This is usually due to missing setscene tasks. Those missing in this build were: {'virtual:native:/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/meta/recipes-support/libgpg-error/libgpg-error_1.42.bb:do_deploy_source_date_epoch',
 'virtual:native:/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/meta/recipes-support/libgpg-error/libgpg-error_1.42.bb:do_populate_sysroot',
 'virtual:native:/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/meta/recipes-support/libmicrohttpd/libmicrohttpd_0.9.73.bb:do_populate_sysroot'}
ERROR: Task (virtual:native:/home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/layers/build/meta/recipes-support/libgpg-error/libgpg-error_1.42.bb:do_fetch) failed with exit code 'setscene whitelist'
ERROR: SDK preparation failed: error log written to /home/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-11730/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/selftest-esdk-xuep12be/preparing_build_system.log

Comment 1 Alexandre Belloni 2021-12-11 15:38:55 UTC

Very similar to bug 14655, is there a race condition while checking the sstate?

Comment 2 Alexandre Belloni 2021-12-15 23:41:05 UTC

https://autobuilder.yoctoproject.org/typhoon/#/builders/63/builds/4140/steps/16/logs/stdio

qemuppc ubuntu1604-ty-1

This time:

ERROR: Task libxml2-native.do_fetch attempted to execute unexpectedly
Task virtual:native:/home/pokybuild/yocto-worker/qemuppc/build/build/tmp/work/qemuppc-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/meta/recipes-core/libxml/libxml2_2.9.12.bb:do_populate_sysroot, unihash db100ff075891eff879f3ecdc2db64e85ab05aea561cca1565aa399af3191532, taskhash db100ff075891eff879f3ecdc2db64e85ab05aea561cca1565aa399af3191532
This is usually due to missing setscene tasks. Those missing in this build were: {'virtual:native:/home/pokybuild/yocto-worker/qemuppc/build/build/tmp/work/qemuppc-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/meta/recipes-core/libxml/libxml2_2.9.12.bb:do_populate_sysroot'}
ERROR: Task (virtual:native:/home/pokybuild/yocto-worker/qemuppc/build/build/tmp/work/qemuppc-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/meta/recipes-core/libxml/libxml2_2.9.12.bb:do_fetch) failed with exit code 'setscene whitelist'

Comment 3 Randy MacLeod 2021-12-16 15:38:30 UTC

task hash mismatch.
Likely not reproducible.
We need better debugging.

Comment 4 Luca Ceresoli 2022-04-22 19:08:02 UTC

https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/3491/steps/14/logs/stdio

oe-selftest-ubuntu on ubuntu1804-ty-3

Comment 5 Randy MacLeod 2022-04-28 15:00:06 UTC

We have better debugging on the SDK failures now.