16080 2025-11-27 08:59:09 +0000 bitbake: fork() use in multi-threaded warning 2026-02-13 12:47:47 +0000 1 1 7 Build System, Metadata & Runtime BitBake bitbake unspecified x86 Multiple RESOLVED FIXED Medium normal 6.0 1 mathieu.dubois-briand mathieu.dubois-briand ccasciato poky.bs.watcher poky.watcher Qi.Chen randy.macleod --- --- No (bug/feature does not impact docs) oldest_to_newest 103393 0 mathieu.dubois-briand 2025-11-27 08:59:09 +0000 We got this warning on a few workers: WARNING: /srv/pokybuild/yocto-worker/qemuarm64-armhost/build/layers/bitbake/lib/bb/daemonize.py:37: DeprecationWarning: This process (pid=1039305) is multi-threaded, use of fork() may lead to deadlocks in the child. 103394 1 mathieu.dubois-briand 2025-11-27 09:01:00 +0000 qemuarm64-armhost debian13-vk-arm1 master-next completed at 2025-11-20 08:34:09+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/8/builds/2774/steps/12/logs/stdio qemux86-alt opensuse155-vk-2 master-next completed at 2025-11-21 11:03:49+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/20/builds/2733/steps/15/logs/stdio qemuarm64-armhost debian13-vk-arm1 master-next completed at 2025-11-21 13:52:29+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/8/builds/2783/steps/12/logs/stdio qemuarm-alt rocky8-vk-1 master completed at 2025-11-26 09:16:28+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/74/builds/2761/steps/14/logs/stdio qemuarm64-armhost debian13-vk-arm1 master completed at 2025-11-27 01:37:05+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/8/builds/2807/steps/12/logs/stdio 103413 2 randy.macleod 2025-11-27 15:52:17 +0000 Probably "fix" by masking the warning... probably. In theory we could deadlock but we've been doing this for years and haven't had a real issue appear. 103454 3 mathieu.dubois-briand 2025-12-02 09:23:53 +0000 qemuarm64-ltp debian13-vk-arm1 mathieu/master-next completed at 2025-11-29 11:05:31+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/98/builds/2655/steps/11/logs/stdio 103469 4 mathieu.dubois-briand 2025-12-03 12:48:28 +0000 qemuarm64-armhost debian13-vk-arm1 master completed at 2025-12-03 01:42:23+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/8/builds/2832/steps/12/logs/stdio qemux86 ubuntu2404-vk-3 mathieu/master-next completed at 2025-12-03 10:07:58+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/30/builds/2788/steps/14/logs/stdio 103486 5 mathieu.dubois-briand 2025-12-04 09:32:42 +0000 qemuarm64-armhost debian13-vk-arm1 master completed at 2025-12-03 21:55:57+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/8/builds/2837/steps/12/logs/stdio 103495 6 mathieu.dubois-briand 2025-12-04 12:22:43 +0000 qemuarm64-ltp debian13-vk-arm1 mathieu/master-next completed at 2025-12-04 11:30:49+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/98/builds/2672/steps/11/logs/stdio qemux86-world opensuse156-vk-1 mathieu/master-next completed at 2025-12-04 10:47:38+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/59/builds/2825/steps/12/logs/stdio 103499 7 mathieu.dubois-briand 2025-12-05 12:09:04 +0000 I was not able to reproduce this locally, but I believe the filter we have in bitbake-server and bitbake-worker should be imported to bitbake-layers. I've created such a patch, I will let it sit in my branch for a few days to check if the issue is indeed fixed. https://git.openembedded.org/bitbake-contrib/commit/?h=mathieu/master-next&id=ba07270ef9fbdaeaf43f4ef18d71098e8e4cb11e 103507 8 mathieu.dubois-briand 2025-12-08 10:18:01 +0000 qemuarm64-ptest debian13-vk-arm1 master completed at 2025-12-08 01:37:13+00:00 https://valkyrie.yocto.io/pub/non-release/20251208-8/testresults/qemuarm64-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/2682/steps/11/logs/stdio 103511 9 mathieu.dubois-briand 2025-12-09 08:31:00 +0000 Patch merged https://git.openembedded.org/bitbake/commit/?id=8b02d65a6439b21d8bd5590dc0009f2cf29c1de8 103557 10 mathieu.dubois-briand 2025-12-15 13:01:54 +0000 Reopen: I did miss that some occurrences were not from bitbake-config, but from the main bitbake script. Which is a bit strange IMO: why are we only seeing these kind of issues now? 103558 11 mathieu.dubois-briand 2025-12-15 13:11:35 +0000 qemux86-64-x32 rocky8-vk-1 mathieu/master-next completed at 2025-12-13 09:20:41+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/11/builds/2820/steps/14/logs/stdio 103609 12 mathieu.dubois-briand 2025-12-19 08:14:04 +0000 Sent a new fix: https://lists.openembedded.org/g/bitbake-devel/message/18612 103687 13 mathieu.dubois-briand 2026-01-05 09:48:28 +0000 qemux86-64-ltp ubuntu2404-vk-1 master completed at 2026-01-04 21:41:24+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/63/builds/2792/steps/12/logs/stdio SERIOUSLY!!! 103689 14 Qi.Chen 2026-01-05 10:16:34 +0000 What if we put the filter in lib/bb/__init__.py? Does that work? If that work, then bin/bitbake-xxx programs will not need that same filter? 103690 15 mathieu.dubois-briand 2026-01-05 10:35:58 +0000 (In reply to Chen Qi from comment #14) > What if we put the filter in lib/bb/__init__.py? Does that work? > If that work, then bin/bitbake-xxx programs will not need that same filter? Looking at the documentation, this should work. I will try modify the code in that way. 104069 16 mathieu.dubois-briand 2026-01-26 14:07:08 +0000 Importing failures logged to the wrong bugzilla entry. All of these come from the "bitbake" script and should be fixed by the patch present in my branch. qemuarm64-armhost debian13-vk-arm1 master completed at 2026-01-12 08:46:57+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/8/builds/3033/steps/13/logs/stdio qemux86-64-ltp rocky8-vk-1 master-next completed at 2026-01-13 14:27:32+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/63/builds/2840/steps/13/logs/stdio qemuarm-oecore rocky8-vk-1 master-next completed at 2026-01-13 19:59:08+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/40/builds/3005/steps/13/logs/stdio qemux86-alt rocky8-vk-1 master&master-next completed at 2026-01-14 18:27:43+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/20/builds/3001/steps/15/logs/stdio qa-extras2 alma8-vk-2 master completed at 2026-01-14 20:43:31+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/26/builds/3011/steps/13/logs/stdio qemux86-world-alt alma8-vk-1 master-next&master completed at 2026-01-20 14:55:49+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/17/builds/2903/steps/13/logs/stdio 104132 17 mathieu.dubois-briand 2026-01-31 09:25:14 +0000 qemuarm64 debian13-vk-2 master completed at 2026-01-31 02:28:11+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/36/builds/3120/steps/14/logs/stdio qemux86-world ubuntu2504-vk-1 master completed at 2026-01-31 01:21:36+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/59/builds/3121/steps/12/logs/stdio 104150 18 mathieu.dubois-briand 2026-02-04 12:04:36 +0000 wic opensuse155-vk-2 master completed at 2026-02-03 01:26:44+00:00 https://autobuilder.yoctoproject.org/valkyrie/#/builders/15/builds/3075/steps/13/logs/stdio 104296 19 mathieu.dubois-briand 2026-02-13 12:47:47 +0000 New fix merged: https://git.openembedded.org/bitbake/commit/?id=2834c4dfa932547ba9e20e00895b8ac1e4ba9cd6