Bug 16206

Summary: [scarthgap] AB-INT: runtime_test.SystemTap.test_crosstap_* failures
Product: [QA/Testing] Functional (self) Testing Reporter: Yoann Congal <yoann.congal>
Component: oe-selftestAssignee: Yoann Congal <yoann.congal>
Status: NEW --- QA Contact:
Severity: normal    
Priority: Medium CC: jeremy.rosen, randy.macleod
Version: 5.0.16   
Target Milestone: 5.0.22   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Yoann Congal 2026-03-17 15:51:05 UTC
scarthgap oe-selftest-fedora alma8-vk-2 https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/3320

There are 2 errors:
* When reparsing ... basehash value changed
* systemtap-native failing on missing readline/readline.h

2026-03-17 00:02:12,944 - oe-selftest - INFO - runtime_test.SystemTap.test_crosstap_helloworld (subunit.RemotedTestCase)
2026-03-17 00:02:12,946 - oe-selftest - INFO -  ... FAIL

Stderr:
2026-03-16 23:49:04,413 - oe-selftest - INFO - Adding: "include selftest.inc" in /srv/pokybuild/yocto-worker/oe-selftest-fedora/build/build-st-3693358/conf/local.conf
2026-03-16 23:49:04,413 - oe-selftest - INFO - Adding: "include bblayers.inc" in bblayers.conf
/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.12/unittest/case.py:580: RuntimeWarning: TestResult has no addDuration method
  warnings.warn("TestResult has no addDuration method",

ERROR: When reparsing /tmp/selftest-fetchhr83rs46/test.bb:do_checkuri, the basehash value changed from 84b9e23a83a764e7a5d8a96ee523199e2b1c604f4280a45030e248de0ff52962 to 4123da244f465feffecb2b4fd2b132b64851981ec2fb70bf9445df8b0ea6a69e. The metadata is not deterministic and this needs to be fixed.
ERROR: The following commands may help:
ERROR: $ bitbake test -cdo_checkuri -Snone
ERROR: Then:
ERROR: $ bitbake test -cdo_checkuri -Sprintdiff

[...]

ERROR: When reparsing /tmp/selftest-fetchhr83rs46/test.bb:do_populate_lic, the basehash value changed from 83cb6a22d3075cc6e588c8181c0714d165ef27ffbdbd23fb7bac2b2da4b14b9b to 8908b14dc58f59b58ff00c5b852200105a14307e85f4aa8792068a8a2a0909cb. The metadata is not deterministic and this needs to be fixed.
ERROR: The following commands may help:
ERROR: $ bitbake test -cdo_populate_lic -Snone
ERROR: Then:
ERROR: $ bitbake test -cdo_populate_lic -Sprintdiff

2026-03-17 00:02:12,946 - oe-selftest - INFO - 14: 20/25 219/597 (63.43s) (0 failed) (runtime_test.SystemTap.test_crosstap_helloworld)
2026-03-17 00:02:12,946 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/meta/lib/oeqa/selftest/cases/runtime_test.py", line 443, in test_crosstap_helloworld
    bitbake('systemtap-native')
  File "/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/meta/lib/oeqa/utils/commands.py", line 234, in bitbake
    return runCmd(cmd, ignore_status, timeout, output_log=output_log, **options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/meta/lib/oeqa/utils/commands.py", line 212, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command 'bitbake  systemtap-native' returned non-zero exit status 1:
Loading cache...done.
Loaded 0 entries from dependency cache.
Parsing recipes...done.
Parsing of 989 .bb files complete (0 cached, 989 parsed). 1966 targets, 56 skipped, 0 masked, 0 errors.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "2.8.1"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
DISTRO               = "poky"
DISTRO_VERSION       = "5.0.16"
TUNE_FEATURES        = "m64 core2"
TARGET_FPU           = ""
meta                 
meta-poky            
meta-yocto-bsp       = "stable/scarthgap-nut:d1c1147a75b5c5988c48958dc72ec90a5e23fd40"
meta-selftest        = "master:6e776de33cd9799456ace9e5366b76c107c31a60"

Initialising tasks...NOTE: The /proc/pressure files can't be read. Continuing build without monitoring pressure
Sstate summary: Wanted 151 Local 150 Mirrors 0 Missed 1 Current 117 (99% match, 99% complete)
done.
NOTE: Executing Tasks
[...]
NOTE: Running task 803 of 807 (/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/meta/recipes-kernel/systemtap/systemtap-native_git.bb:do_compile)
NOTE: recipe systemtap-native-5.0-r0: task do_compile: Started
ERROR: systemtap-native-5.0-r0 do_compile: oe_runmake failed
ERROR: systemtap-native-5.0-r0 do_compile: ExecutionError('/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/build-st-3693358/tmp/work/x86_64-linux/systemtap-native/5.0/temp/run.do_compile.1259419', 1, None, None)
ERROR: Logfile of failure stored in: /srv/pokybuild/yocto-worker/oe-selftest-fedora/build/build-st-3693358/tmp/work/x86_64-linux/systemtap-native/5.0/temp/log.do_compile.1259419
Log data follows:
| DEBUG: Executing python function autotools_aclocals
| DEBUG: SITE files ['endian-little', 'common-linux', 'common-glibc', 'bit-64', 'x86_64-linux', 'common']
| DEBUG: Python function autotools_aclocals finished
| DEBUG: Executing shell function do_compile
| NOTE: make -j 16 -l 75
| sed -e "s#@pkgdatadir@#/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/build-st-3693358/tmp/work/x86_64-linux/systemtap-native/5.0/recipe-sysroot-native/usr/share/systemtap#g" < ../git/macros.systemtap.in > macros.systemtap
| /bin/bash ../git/git_version.sh -k -s ../git -o git_version.h
| git_version.sh: Output is new file, creating git_version.h
| make  all-recursive
| make[1]: Entering directory '/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/build-st-3693358/tmp/work/x86_64-linux/systemtap-native/5.0/build'
| Making all in .
| make[2]: Entering directory '/srv/pokybuild/yocto-worker/oe-selftest-fedora/build/build-st-3693358/tmp/work/x86_64-linux/systemtap-native/5.0/build'
[...]
| g++  [...] -c -o stap-bpf-translate.o `test -f 'bpf-translate.cxx' || echo '../git/'`bpf-translate.cxx
| ../git/interactive.cxx:33:10: fatal error: readline/readline.h: No such file or directory
|    33 | #include <readline/readline.h>
|       |          ^~~~~~~~~~~~~~~~~~~~~
| compilation terminated.
[...]

Summary: 1 task failed:
  /srv/pokybuild/yocto-worker/oe-selftest-fedora/build/meta/recipes-kernel/systemtap/systemtap-native_git.bb:do_compile
    log: /srv/pokybuild/yocto-worker/oe-selftest-fedora/build/build-st-3693358/tmp/work/x86_64-linux/systemtap-native/5.0/temp/log.do_compile.1259419
Summary: There were 2 ERROR messages, returning a non-zero exit code.
Comment 1 Yoann Congal 2026-03-19 14:36:15 UTC
Again on whinlatter this time:
whinlatter oe-selftest-fedora rocky8-vk-1 https://autobuilder.yoctoproject.org/valkyrie/?#/builders/48/builds/3351:
  ../sources/systemtap-5.3/interactive.cxx:33:10: fatal error: readline/readline.h: No such file or directory

But no "When reparsing ... basehash value changed" this time.
Comment 2 Randy MacLeod 2026-03-19 14:51:54 UTC
Might be worth checking the difference bitbake/lib/bb/runqeue.py in scarthgap and master.

Is readline installed on the host?
Comment 3 Yoann Congal 2026-03-19 19:43:59 UTC
(In reply to Randy MacLeod from comment #2)
> Is readline installed on the host?

It is installed on the host:
[ycongal@rocky8-vk-1 build]$ find /usr/include/ -name readline.h
/usr/include/readline/readline.h

... but is should not matter because:
1. I succesfully built systemtap-native on a rocky8 container withou readline-devel installed
2. readline.h, then, comes from our editline-native which is an indirect dependency of systemtap-native (editline is "A small replacement for GNU readline() for UNIX")
Comment 4 Yoann Congal 2026-05-05 14:40:44 UTC
oe-selftest-fedora alma8-vk-1 scarthgap completed at 2026-05-04 15:49:23+00:00
https://autobuilder.yoctoproject.org/valkyrie/?#/builders/48/builds/3662
Comment 5 Yoann Congal 2026-06-10 08:00:11 UTC
a-full ubuntu2404-vk-2 scarthgap completed at 2026-06-09 21:23:41+00:00
https://autobuilder.yoctoproject.org/valkyrie/?#/builders/29/builds/3955
Comment 6 Jérémy Rosen 2026-06-12 07:09:25 UTC
a-full ubuntu2404-vk-3 scarthgap completed at 2026-06-11 20:56:47+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/3976
Comment 7 Yoann Congal 2026-06-23 05:19:30 UTC
oe-selftest-fedora alma8-vk-1 scarthgap completed at 2026-06-23 01:33:34+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/3951

Note: there are "ERROR: When reparsing /tmp/selftest-fetchapezz_ud/test.bb:do_checkuri, the basehash value changed from ... to ..." lines this time
Comment 8 Yoann Congal 2026-07-06 15:55:45 UTC
oe-selftest-fedora alma8-vk-2 scarthgap completed at 2026-07-06 15:13:28+00:00
https://autobuilder.yoctoproject.org/valkyrie/?#/builders/48/builds/4057
Comment 9 Yoann Congal 2026-09-07 13:32:44 UTC
oe-selftest-fedora alma8-vk-1 scarthgap completed at 2026-09-06 02:41:35+00:00
https://autobuilder.yoctoproject.org/valkyrie/?#/builders/48/builds/4592
Comment 10 Yoann Congal 2026-09-23 09:04:29 UTC
oe-selftest-fedora alma8-vk-1 scarthgap completed at 2026-09-23 02:14:48+00:00
https://autobuilder.yoctoproject.org/valkyrie/?#/builders/48/builds/4718
Comment 11 Yoann Congal 2026-10-03 21:27:24 UTC
oe-selftest-fedora rocky8-vk-1 scarthgap completed at 2026-10-02 18:31:54+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/4799
Comment 12 Yoann Congal 2026-10-30 21:53:24 UTC
oe-selftest-fedora alma8-vk-1 scarthgap completed at 2026-10-29 11:35:32+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/4966