On master branch, qemux86-64 machine Worker: debian9-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/56/builds/1609 Error log: 2021-10-02 07:53:59,251 - oe-selftest - INFO - ====================================================================== 2021-10-02 07:54:00,977 - oe-selftest - INFO - FAIL: tinfoil.TinfoilTests.test_wait_event (subunit.RemotedTestCase) 2021-10-02 07:54:00,977 - oe-selftest - INFO - ---------------------------------------------------------------------- 2021-10-02 07:54:00,977 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last): File "/home/pokybuild/yocto-worker/oe-selftest/build/meta/lib/oeqa/selftest/cases/tinfoil.py", line 121, in test_wait_event self.assertTrue(commandcomplete, 'Timed out waiting for CommandCompleted event from bitbake server') File "/home/pokybuild/yocto-worker/oe-selftest/build/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.9/unittest/case.py", line 682, in assertTrue raise self.failureException(msg) AssertionError: False is not true : Timed out waiting for CommandCompleted event from bitbake server
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2830/steps/14/logs/stdio On CentOS-8 this time.
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2718/steps/14/logs/stdio oe-selftest-centos centos8-ty-1
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2980/steps/14/logs/stdio oe-selftest-centos centos8-ty-1
https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/2853/steps/14/logs/stdio fedora33-ty-1
https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/3065/steps/14/logs/stdio fedora35-ty-2 has an SSD
https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/3093/steps/14/logs/stdio fedora35-ty-2 has an SSD
Dunfell occurrence: https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/3175/steps/14/logs/stdio oe-selftest-fedora fedora34-ty-1
Dunfell occurrence: https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3235 oe-selftest-centos alma8-ty-2 SSD
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3280/steps/14/logs/stdio oe-selftest-centos alma8-ty-1 SSD
Dunfell: https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3309/steps/14/logs/stdio oe-selftest-centos alma8-ty-1
Dunfell: https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/3319 oe-selftest-ubuntu ubuntu1604-ty-1
Dunfell: https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3335 oe-selftest-centos centos8-ty-1
This last failure shows: AssertionError: False is not true : Timed out waiting for CommandCompleted event from bitbake server (Matching event received: False) which is with the extra debugging. This means that neither the event we're looking for or the command completed. I was also able to find the cookerdaemon log: https://autobuilder.yocto.io/pub/failed-builds-data/centos8-ty-1-20220323-tinfoil/bitbake-cookerdaemon.log the key piece of which is: Running command ['setEventMask', 2, 20, {'BitBake.SigGen.HashEquiv': 19, 'BitBake.RunQueue.HashEquiv': 19}, ['bb.event.FilesMatchingFound', 'bb.command.CommandCompleted', 'bb.command.CommandFailed', 'bb.command.CommandExit']] Running command ['testCookerCommandEvent', 'conf'] Running command ['clientComplete'] Processing Client so the cooker did get the command and did have an event mask with the right events allowed but the command never ran? It was also alive enough to shut down...
Issue identified, patches on the list. The issue was tinfoil's run_command swallowing the events.
https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3342/steps/14/logs/stdio This didn't have the fix
Fixed with: https://git.yoctoproject.org/poky/commit/?id=a10ac380b781073fc995a3ee245d570f7b49055d https://git.yoctoproject.org/poky/commit/?id=075aeeff2bb5be176e6d58ad3f1e7b7fb2d5b762
bulk change to add Saul's non-WR address.
Bulk change: Remove Saul's old WR address.