Bug 13667

Summary: pid recycling problems in bitbake?
Product: [Build System, Metadata & Runtime] BitBake Reporter: Richard Purdie <richard.purdie>
Component: bitbakeAssignee: Richard Purdie <richard.purdie>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: poky.bs.watcher, poky.watcher, randy.macleod
Version: 3.1   
Target Milestone: 3.1 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Richard Purdie 2019-12-03 20:59:30 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/101/builds/213

NOTE: recipe pango-1.44.7-r0: task do_configure: Succeeded
NOTE: recipe nfs-utils-2.4.1-r0: task do_package: Succeeded
NOTE: Task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-connectivity/nfs-utils/nfs-utils_2.4.1.bb:do_package unihash changed to 9407bbcb3ea4b6a14e51f58c3c81d11dd6f3d33ef3a781ad0d4ceca039530f75
NOTE: Setscene task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-connectivity/nfs-utils/nfs-utils_2.4.1.bb:do_packagedata became valid
NOTE: recipe harfbuzz-2.6.4-r0: task do_package: Succeeded
NOTE: Task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-graphics/harfbuzz/harfbuzz_2.6.4.bb:do_package unihash changed to da97b7b5c3af719e05cbce1c87271c49543a2f7e38e7a0bfc0402c8d59687447
NOTE: Task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-connectivity/openssl/openssl_1.1.1d.bb:do_package_write_ipk unihash changed to 8078610f23d2b017221563a2448e0da0b01568d213cd1b08ee843539d87d61bd
NOTE: Setscene task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-graphics/harfbuzz/harfbuzz_2.6.4.bb:do_package_write_deb became valid
NOTE: Setscene task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-graphics/harfbuzz/harfbuzz_2.6.4.bb:do_package_qa became valid
NOTE: Setscene task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-graphics/harfbuzz/harfbuzz_2.6.4.bb:do_package_write_rpm became valid
NOTE: Setscene task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-graphics/harfbuzz/harfbuzz_2.6.4.bb:do_package_write_ipk became valid
NOTE: Setscene task /home/pokybuild/yocto-worker/qemux86-alt/build/meta/recipes-graphics/harfbuzz/harfbuzz_2.6.4.bb:do_packagedata became valid
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemux86-alt/build/bitbake/lib/bb/ui/knotty.py", line 484, in main
    helper.eventHandler(event)
  File "/home/pokybuild/yocto-worker/qemux86-alt/build/bitbake/lib/bb/ui/uihelper.py", line 30, in eventHandler
    del self.running_tasks[event.pid]
KeyError: 13490


Lots of pid recycling going on:

[pokybuild@centos7-ty-1 build-renamed]$ ls -la --full-time tmp/work/*/*/*/temp/*.13490
-rw-r--r--. 1 pokybuild pokybuild  2816 2019-12-03 20:19:40.403693522 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/depsig.do_package_write_ipk.13490
-rw-r--r--. 1 pokybuild pokybuild  4209 2019-12-03 20:19:40.695695695 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/log.do_package_write_ipk.13490
-rw-r--r--. 1 pokybuild pokybuild  1335 2019-12-03 20:19:40.615695100 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.buildhistory_emit_outputsigs.13490
-rw-r--r--. 1 pokybuild pokybuild 14971 2019-12-03 20:19:40.675695546 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.buildhistory_emit_pkghistory.13490
-rw-r--r--. 1 pokybuild pokybuild 13374 2019-12-03 20:19:09.638464647 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.do_package_ipk.13490
-rw-r--r--. 1 pokybuild pokybuild 15096 2019-12-03 20:19:09.556464036 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.do_package_write_ipk.13490
-rw-r--r--. 1 pokybuild pokybuild 25246 2019-12-03 20:19:03.468418745 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.extend_recipe_sysroot.13490
-rw-r--r--. 1 pokybuild pokybuild  1617 2019-12-03 20:19:09.560464066 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.read_subpackage_metadata.13490
-rwxr-xr-x. 1 pokybuild pokybuild 11260 2019-12-03 20:19:40.508694304 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.sstate_create_package.13490
-rw-r--r--. 1 pokybuild pokybuild  2593 2019-12-03 20:19:39.994690480 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.sstate_hardcode_path.13490
-rw-r--r--. 1 pokybuild pokybuild  2493 2019-12-03 20:19:40.612695077 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.sstate_hardcode_path_unpack.13490
-rw-r--r--. 1 pokybuild pokybuild  2195 2019-12-03 20:19:40.059690963 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.sstate_report_unihash.13490
-rw-r--r--. 1 pokybuild pokybuild 27407 2019-12-03 20:19:39.953690174 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.sstate_task_postfunc.13490
-rw-r--r--. 1 pokybuild pokybuild  4831 2019-12-03 20:19:03.457418663 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.sstate_task_prefunc.13490
-rw-r--r--. 1 pokybuild pokybuild  1096 2019-12-03 20:19:40.618695122 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/run.uninative_changeinterp.13490
-rw-r--r--. 1 pokybuild pokybuild  6650 2019-12-03 20:20:07.184892759 +0000 tmp/work/core2-32-poky-linux/pango/1.44.7-r0/temp/log.do_configure.13490
-rwxrwxr-x. 1 pokybuild pokybuild 14139 2019-12-03 20:20:02.254856083 +0000 tmp/work/core2-32-poky-linux/pango/1.44.7-r0/temp/run.do_configure.13490
-rw-r--r--. 1 pokybuild pokybuild  5505 2019-12-03 20:20:07.172892670 +0000 tmp/work/core2-32-poky-linux/pango/1.44.7-r0/temp/run.do_qa_configure.13490
Comment 1 Richard Purdie 2019-12-03 21:04:20 UTC
-rw-r--r--. 1 pokybuild pokybuild  6650 2019-12-03 20:20:07.184892759 +0000 tmp/work/core2-32-poky-linux/pango/1.44.7-r0/temp/log.do_configure.13490

-rw-r--r--. 1 pokybuild pokybuild  4209 2019-12-03 20:19:40.695695695 +0000 tmp/work/core2-32-poky-linux/openssl/1.1.1d-r0/temp/log.do_package_write_ipk.13490

Both tasks running at the same time, UI handler was lagging and got confused as pid wasn't unique to the task.

Need to teach the UI to use TIDs instead.