Bug 15490 - pseudo: aborts with python-3.13 on host
Summary: pseudo: aborts with python-3.13 on host
Status: RESOLVED FIXED
Alias: None
Product: Pseudo
Classification: Yocto Project Subprojects
Component: pseudo (show other bugs)
Version: 5.1
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 5.2 M1
Assignee: Unassigned
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2024-05-22 21:28 UTC by Martin Jansa
Modified: 2024-11-14 16:25 UTC (History)
9 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Martin Jansa 2024-05-22 21:28:27 UTC
It's still in beta and dev-lang/python-3.13.0_beta1_p2 version on gentoo doesn't pass its own testsuite when pgo is enabled (https://bugs.gentoo.org/931888) so I have built it with pgo disabled.

Just reporting it here for "later" if this issue is reproducible on other hosts with python-3.13 as well when it gets more wide spread and closer to release.

Easiest and fastest way to reproduce was:
bitbake -c cleansstate base-files; bitbake base-files
with oe-core/master as of https://git.openembedded.org/openembedded-core/commit/?id=094273bd7d1768e14fbdcd2f239bee14c630a625
but the issue was triggered in other recipes as well, e.g.
path mismatch [2 links]: ino 30803985 db '/OE/build/oe-core/tmp-glibc/work/core2-64-oe-linux/glibc/2.39+git/packages-split/tzcode/usr/bin/tzselect' req '/OE/build/oe-core/tmp-
glibc/work/core2-64-oe-linux/glibc/2.39+git/package/usr/bin/tzselect'.

D is identical:
$ diff -rq tmp-glibc-python-3.1*/work/*/base-files/*/image
diff: tmp-glibc-python-3.12/work/qemux86_64-oe-linux/base-files/3.0.14/image/var/lock: No such file or directory
diff: tmp-glibc-python-3.13/work/qemux86_64-oe-linux/base-files/3.0.14/image/var/lock: No such file or directory

The error (in clean TMPDIR without after -c cleansstate):

oe-core $ cat tmp-glibc-python-3.13/work/*/base-files/*/pseudo/pseudo.log
debug_logfile: fd 2
pid 1987233 [parent 1987232], doing new pid setup and server start
Setup complete, sending SIGUSR1 to pid 1987232.
db cleanup for server shutdown, 22:40:24.746
memory-to-file backup complete, 22:40:24.746.
db cleanup finished, 22:40:24.746
debug_logfile: fd 2
pid 2172755 [parent 2172754], doing new pid setup and server start
Setup complete, sending SIGUSR1 to pid 2172754.
path mismatch [2 links]: ino 54143891 db '/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/packages-split/base-files/etc/issue' req '/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/sstate-build-package/package/etc/issue'.
db cleanup for server shutdown, 22:47:16.491
memory-to-file backup complete, 22:47:16.491.
db cleanup finished, 22:47:16.491

the database seems OK to me, but the one with 3.13 doesn't have entry for package/etc/issue only for packages-split/base-files/etc/issue

martin@jama /OE/build/oe-core $ sqlite3  tmp-glibc-python-3.12/work/*/base-files/*/pseudo/files.db "select * from files where path like '%issue';"
44|/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/image/etc/issue|66308|54659222|0|0|33188|0|0
82|/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/package/etc/issue|66308|55221849|0|0|33188|0|0
149|/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/packages-split/base-files/etc/issue|66308|55221849|0|0|33188|0|0

martin@jama /OE/build/oe-core $ sqlite3  tmp-glibc-python-3.13/work/*/base-files/*/pseudo/files.db "select * from files where path like '%issue';"
44|/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/image/etc/issue|66308|52696904|0|0|33188|0|0
109|/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/packages-split/base-files/etc/issue|66308|54143891|1026|1026|33188|0|0

--- tmp-glibc-python-3.12/work/qemux86_64-oe-linux/base-files/3.0.14/temp/log.do_package        2024-05-22 22:49:13.756690924 +0200
+++ tmp-glibc-python-3.13/work/qemux86_64-oe-linux/base-files/3.0.14/temp/log.do_package        2024-05-22 23:22:29.692477142 +0200
@@ -68,24 +68,3 @@
 DEBUG: Python function do_package finished
 DEBUG: Executing python function sstate_task_postfunc
 NOTE: Using umask 0o002 (not 22) for sstate packaging
-DEBUG: Executing python function target_add_sysroot_deps
-DEBUG: Python function target_add_sysroot_deps finished
-DEBUG: Executing python function sstate_hardcode_path
-NOTE: Removing hardcoded paths from sstate package: 'find /OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/sstate-build-package/ \( -name "*.la" -o -name "*-config" -o -name "*_config" -o -name "postinst-*" \) -type
 f | xargs grep -l -e '/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/recipe-sysroot' -e '/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/recipe-sysroot-native' -e '/OE/build/oe-core/tmp-glib
c/hosttools' | tee /OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/sstate-build-package/fixmepath | xargs --no-run-if-empty sed -i -e 's:/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/recipe-
sysroot-native:FIXMESTAGINGDIRHOST:g' -e 's:/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/recipe-sysroot:FIXMESTAGINGDIRTARGET:g' -e 's:/OE/build/oe-core/tmp-glibc/hosttools:FIXME_HOSTTOOLS_DIR:g''
-DEBUG: Python function sstate_hardcode_path finished
-DEBUG: Executing python function sstate_report_unihash
-DEBUG: Python function sstate_report_unihash finished
-DEBUG: Executing python function sstate_create_and_sign_package
-DEBUG: Executing shell function sstate_archive_package
-DEBUG: Shell function sstate_archive_package finished
-DEBUG: Python function sstate_create_and_sign_package finished
-DEBUG: Executing python function sstate_hardcode_path_unpack
-DEBUG: Python function sstate_hardcode_path_unpack finished
-DEBUG: Executing python function buildhistory_emit_outputsigs
-DEBUG: Python function buildhistory_emit_outputsigs finished
-DEBUG: Executing python function buildhistory_emit_pkghistory
-DEBUG: Executing shell function buildhistory_list_pkg_files
-find: ‘/OE/build/oe-core/tmp-glibc/work/qemux86_64-oe-linux/base-files/3.0.14/packages-split/*’: No such file or directory
-DEBUG: Shell function buildhistory_list_pkg_files finished
-DEBUG: Python function buildhistory_emit_pkghistory finished
-DEBUG: Python function sstate_task_postfunc finished


martin@jama /OE/build/oe-core $ ls tmp-glibc-python-3.12/work/qemux86_64-oe-linux/base-files/3.0.14/
configure.sstate          license-destdir  pkgdata-pdata-input  recipe-sysroot-native  sstate-install-create_runtime_spdx       sstate-install-package_qa         sstate-install-populate_sysroot
deploy-ipks               package          pkgdata-sysroot      source-date-epoch      sstate-install-create_spdx               sstate-install-package_write_ipk  sstate-install-recipe_qa
deploy-source-date-epoch  packages-split   pseudo               sources                sstate-install-deploy_source_date_epoch  sstate-install-packagedata        sysroot-destdir
image                     pkgdata          recipe-sysroot       spdx                   sstate-install-package                   sstate-install-populate_lic       temp
martin@jama /OE/build/oe-core $ ls tmp-glibc-python-3.13/work/qemux86_64-oe-linux/base-files/3.0.14/
configure.sstate          image            packages-split  pkgdata-sysroot  recipe-sysroot         source-date-epoch  spdx                  sstate-install-deploy_source_date_epoch  sstate-install-populate_sysroot  sysroot-destdir
deploy-source-date-epoch  license-destdir  pkgdata         pseudo           recipe-sysroot-native  sources            sstate-build-package  sstate-install-populate_lic              sstate-install-recipe_qa         temp
Comment 1 Randy MacLeod 2024-05-23 14:37:55 UTC
Waiting to see how this goes as 3.13 is still in beta.
Comment 2 Randy MacLeod 2024-09-24 14:48:25 UTC
python-3.13 is scheduled for release on Oct 1, 2024:
https://peps.python.org/pep-0719/

Raise importance to M+ and move to 5.2-M1.
Comment 3 Martin Jansa 2024-10-08 10:49:02 UTC
I can confirm that with the pseudo fix from RP https://patchwork.yoctoproject.org/project/yocto/patch/20241003113018.3531433-2-richard.purdie@linuxfoundation.org/ I was able to build image with python-3.13 on gentoo where it was failing before.
Comment 4 Richard Purdie 2024-11-14 16:25:24 UTC
Issue has been resolved as above.