14585 2021-10-04 03:37:29 +0000 oe-selftest: tinfoil.TinfoilTests.test_wait_event failure 2025-02-14 16:48:13 +0000 1 1 7 Build System, Metadata & Runtime OE-Core core 5.99 x86 Multiple RESOLVED FIXED AB-INT AB-SSD Medium+ normal 4.0 M4 1 naveen.kumar.saini unassigned alexandre.belloni anuj.mittal meta.mr.watcher meta.watcher randy.macleod richard.purdie sgw steve --- --- No (bug/feature does not impact docs) oldest_to_newest 91648 0 naveen.kumar.saini 2021-10-04 03:37:29 +0000 On master branch, qemux86-64 machine Worker: debian9-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/56/builds/1609 Error log: 2021-10-02 07:53:59,251 - oe-selftest - INFO - ====================================================================== 2021-10-02 07:54:00,977 - oe-selftest - INFO - FAIL: tinfoil.TinfoilTests.test_wait_event (subunit.RemotedTestCase) 2021-10-02 07:54:00,977 - oe-selftest - INFO - ---------------------------------------------------------------------- 2021-10-02 07:54:00,977 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last): File "/home/pokybuild/yocto-worker/oe-selftest/build/meta/lib/oeqa/selftest/cases/tinfoil.py", line 121, in test_wait_event self.assertTrue(commandcomplete, 'Timed out waiting for CommandCompleted event from bitbake server') File "/home/pokybuild/yocto-worker/oe-selftest/build/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.9/unittest/case.py", line 682, in assertTrue raise self.failureException(msg) AssertionError: False is not true : Timed out waiting for CommandCompleted event from bitbake server 91941 1 anuj.mittal 2021-11-10 09:11:37 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2830/steps/14/logs/stdio On CentOS-8 this time. 92172 2 alexandre.belloni 2021-12-15 23:45:31 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2718/steps/14/logs/stdio oe-selftest-centos centos8-ty-1 92240 3 alexandre.belloni 2022-01-07 13:29:08 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/2980/steps/14/logs/stdio oe-selftest-centos centos8-ty-1 92262 4 alexandre.belloni 2022-01-08 00:12:29 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/2853/steps/14/logs/stdio fedora33-ty-1 92432 5 alexandre.belloni 2022-01-31 20:15:50 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/3065/steps/14/logs/stdio fedora35-ty-2 has an SSD 92486 6 saul.wold 2022-02-07 18:41:17 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/3093/steps/14/logs/stdio fedora35-ty-2 has an SSD 92664 7 steve 2022-02-24 16:33:22 +0000 Dunfell occurrence: https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/3175/steps/14/logs/stdio oe-selftest-fedora fedora34-ty-1 92706 8 steve 2022-03-02 16:03:13 +0000 Dunfell occurrence: https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3235 oe-selftest-centos alma8-ty-2 SSD 92788 9 alexandre.belloni 2022-03-17 10:26:59 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3280/steps/14/logs/stdio oe-selftest-centos alma8-ty-1 SSD 92811 10 steve 2022-03-17 21:28:12 +0000 Dunfell: https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3309/steps/14/logs/stdio oe-selftest-centos alma8-ty-1 92819 11 steve 2022-03-19 18:25:14 +0000 Dunfell: https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/3319 oe-selftest-ubuntu ubuntu1604-ty-1 92844 12 steve 2022-03-24 13:55:23 +0000 Dunfell: https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3335 oe-selftest-centos centos8-ty-1 92858 13 richard.purdie 2022-03-24 15:42:18 +0000 This last failure shows: AssertionError: False is not true : Timed out waiting for CommandCompleted event from bitbake server (Matching event received: False) which is with the extra debugging. This means that neither the event we're looking for or the command completed. I was also able to find the cookerdaemon log: https://autobuilder.yocto.io/pub/failed-builds-data/centos8-ty-1-20220323-tinfoil/bitbake-cookerdaemon.log the key piece of which is: Running command ['setEventMask', 2, 20, {'BitBake.SigGen.HashEquiv': 19, 'BitBake.RunQueue.HashEquiv': 19}, ['bb.event.FilesMatchingFound', 'bb.command.CommandCompleted', 'bb.command.CommandFailed', 'bb.command.CommandExit']] Running command ['testCookerCommandEvent', 'conf'] Running command ['clientComplete'] Processing Client so the cooker did get the command and did have an event mask with the right events allowed but the command never ran? It was also alive enough to shut down... 92864 14 richard.purdie 2022-03-24 17:49:02 +0000 Issue identified, patches on the list. The issue was tinfoil's run_command swallowing the events. 92872 15 alexandre.belloni 2022-03-25 11:48:07 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/79/builds/3342/steps/14/logs/stdio This didn't have the fix 92899 16 richard.purdie 2022-03-31 14:50:55 +0000 Fixed with: https://git.yoctoproject.org/poky/commit/?id=a10ac380b781073fc995a3ee245d570f7b49055d https://git.yoctoproject.org/poky/commit/?id=075aeeff2bb5be176e6d58ad3f1e7b7fb2d5b762 100965 17 randy.macleod 2025-02-14 16:46:22 +0000 bulk change to add Saul's non-WR address. 101035 18 randy.macleod 2025-02-14 16:48:13 +0000 Bulk change: Remove Saul's old WR address.