16235 2026-04-08 10:03:46 +0000 Python recipes occasionally fail with "invalid command 'egg_info'" 2026-04-21 17:01:13 +0000 1 1 7 Build System, Metadata & Runtime OE-Core core 6.0 x86 Multiple RESOLVED FIXED Medium normal 6.1 1 peter.kjellerstedt ross.burton meta.mr.watcher meta.watcher pavel peter.kjellerstedt randy.macleod tim.orling --- --- No (bug/feature does not impact docs) oldest_to_newest 104983 0 peter.kjellerstedt 2026-04-08 10:03:46 +0000 Occasionally most (all?) python recipes fail to compile with: error: invalid command 'egg_info' Running `bitbake -c clean` for the affected recipes get them back to working. I have not figured out what triggers the problem or a way to reproduce it. It typically happens after updating the openembedded-core layer so my guess is that it is related to some tasks being fetched from the sstate cache, and some tasks having to rebuild. Here is a full error log for `python3-calver-native`: DEBUG: Executing shell function do_compile + cd .../qemux86-64-alt/tmp/work/x86_64-linux/python3-calver-native/2025.10.20/sources/python3-calver-2025.10.20 + do_compile + python_pep517_do_compile + pyproject-build --no-isolation --wheel --outdir .../qemux86-64-alt/tmp/work/x86_64-linux/python3-calver-native/2025.10.20/dist .../qemux86-64-alt/tmp/work/x86_64-linux/python3-calver-native/2025.10.20/sources/python3-calver-2025.10.20 * Getting build dependencies for wheel... usage: _in_process.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...] or: _in_process.py --help [cmd1 cmd2 ...] or: _in_process.py --help-commands or: _in_process.py cmd --help error: invalid command 'egg_info' ERROR Backend subprocess exited when trying to invoke get_requires_for_build_wheel 105015 1 randy.macleod 2026-04-09 14:44:11 +0000 Also reported by people on IRC. 105017 2 ross.burton 2026-04-09 14:46:30 +0000 The hunch is that this is due to an upgrade happening to dependencies which leaves an empty directory in site-packages, which importlib then reports as a module although it has no metadata. There's an upstream bug somewhere, and I can dig out the fix we'd previously applied. For now, cleaning is acceptable... 105044 3 tim.orling 2026-04-10 21:36:29 +0000 This seems to happen for recipes that inherit `setuptools3` or `python_setuptools_build_meta` when there is stale sstate cache. Or at least `bitbake -c cleansstate python3-pytest` worked for me (several other recipes needed the same). Ross maybe correct that only `bitbake -c clean` is needed. I did not test that. 105045 4 tim.orling 2026-04-10 21:37:40 +0000 s/Ross/Ross and Peter/ 105049 5 pavel 2026-04-12 17:09:08 +0000 (In reply to Tim Orling from comment #3) > This seems to happen for recipes that inherit `setuptools3` or > `python_setuptools_build_meta` when there is stale sstate cache. Or at least > `bitbake -c cleansstate python3-pytest` worked for me (several other recipes > needed the same). Ross maybe correct that only `bitbake -c clean` is needed. > I did not test that. I think it's not because of sstate but workdir. It happened to me only with stale workdir/tmpdir. Simple clean (not cleatsstate) and/or buiding on the builder with shared sstate but with completely new tmpdir solves the problem. 105050 6 peter.kjellerstedt 2026-04-12 17:35:46 +0000 After Ross' comment, I had a feeling of déjà vu. And it turned out to be right. I have apparently been bothered by this before, and after some searching in the logs, I found commit 47d9d90b4ec7d04d6f3f1a9b97c0ab7f1264a88e "meson.bblcass: Remove empty egg-info directories before running meson", where I apparently solved this problem for Meson based projects. However, it appears a more generic solution is needed... 105051 7 peter.kjellerstedt 2026-04-12 17:40:04 +0000 There is also commit 73de8daa6293403f5b92d313af32882c47bce396 "python3: backport the full fix for importlib scanning invalid distributions" by Ross, where a local patch that seems to have ignored empty directories supposedly have been replaced by some upstream fix. 105052 8 peter.kjellerstedt 2026-04-12 17:51:55 +0000 And of course, further investigation of the logs show that my commit (47d9d90b4ec) was reverted in commit ebdb49b9292bf8e61ef0a3f56ff76fcab3ac503f because RP had in fact added a more generic solution in commit e5944a38db513e033c3a3e9313267055f7254be7 "python3: Ensure stale empty python module directories don't break the build". This was the one that Ross later reverted in commit 73de8daa62. So either that backported patch (meta/recipes-devtools/python/python3/valid-dists.patch, which we apparently still have) did not actually solve the problem of empty directories, or upstream has broken them yet again... 105082 9 ross.burton 2026-04-15 16:27:38 +0000 My memory is that the upstream fix we proposed was quite deep in the importlib code and they wanted to return "empty" modules to the caller, so we should go and fix the callers. 105144 10 ross.burton 2026-04-17 15:58:06 +0000 Root-caused and filed a ticket and two potential fixes upstream: https://github.com/python/importlib_metadata/issues/534 105146 11 ross.burton 2026-04-17 16:07:06 +0000 PATCH ON THE LIST. 105175 12 ross.burton 2026-04-21 17:01:13 +0000 Fixed in oe-core 855d1111c3da40edc05ec300839f7003a388e3c4.