Bug 16091 - selftest failures on Ubuntu 25.10
Summary: selftest failures on Ubuntu 25.10
Status: RESOLVED FIXED
Alias: None
Product: Functional (self) Testing
Classification: QA/Testing
Component: oe-selftest (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 6.0 M1
Assignee: Michael Halstead
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2025-12-08 10:15 UTC by Mathieu Dubois-Briand
Modified: 2025-12-17 13:08 UTC (History)
1 user (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Mathieu Dubois-Briand 2025-12-08 10:15:28 UTC
I bet all of these are related to Ubuntu 25.10.

2025-12-05 01:27:06,744 - oe-selftest - INFO - archiver.Archiver.test_archiver_mode_mirror_gitsm (subunit.RemotedTestCase)
2025-12-05 01:27:06,745 - oe-selftest - INFO -  ... FAIL

Stderr:
2025-12-05 01:21:39,277 - oe-selftest - INFO - Adding: "include selftest.inc" in /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-2616602/conf/local.conf
2025-12-05 01:21:39,277 - oe-selftest - INFO - Adding: "include bblayers.inc" in bblayers.conf
/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method
  warnings.warn("TestResult has no addDuration method",

2025-12-05 01:27:06,745 - oe-selftest - INFO - 1: 10/59 105/643 (27.79s) (0 failed) (archiver.Archiver.test_archiver_mode_mirror_gitsm)
2025-12-05 01:27:06,745 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/archiver.py", line 306, in test_archiver_mode_mirror_gitsm
    bitbake('-c deploy_archives -f git-submodule-test')
    ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/utils/commands.py", line 236, in bitbake
    return runCmd(cmd, ignore_status, timeout, output_log=output_log, **options)
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/utils/commands.py", line 214, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command 'bitbake  -c deploy_archives -f git-submodule-test' returned non-zero exit status 1:


2025-12-05 01:36:33,982 - oe-selftest - INFO - devtool.DevtoolDeployTargetTests.test_devtool_deploy_target (subunit.RemotedTestCase)
2025-12-05 01:36:33,982 - oe-selftest - INFO -  ... FAIL
...
2025-12-05 01:36:33,982 - oe-selftest - INFO - 9: 34/95 276/643 (165.58s) (0 failed) (devtool.DevtoolDeployTargetTests.test_devtool_deploy_target)
2025-12-05 01:36:33,982 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/devtool.py", line 1851, in test_devtool_deploy_target
    filelist1 = self._process_ls_output(result.output)
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/devtool.py", line 225, in _process_ls_output
    self.fail('_process_ls_output: invalid output line: %s' % line)
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/unittest/case.py", line 732, in fail
    raise self.failureException(msg)
AssertionError: _process_ls_output: invalid output line: couldn't allocate absolute path for 'null'.

2025-12-05 02:29:04,115 - oe-selftest - INFO - wic.Wic.test_grub_install_pcbios (subunit.RemotedTestCase)
2025-12-05 02:29:04,115 - oe-selftest - INFO -  ... FAIL
2025-12-05 02:29:04,116 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/wic.py", line 244, in test_grub_install_pcbios
    runCmd(cmd)
    ~~~~~~^^^^^
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/utils/commands.py", line 214, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command 'wic create /tmp/tmp6pmsd2q3.wks -e core-image-minimal -o /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-2616674/wic-tmp' returned non-zero exit status 1:
...
ERROR: Actual rootfs size (1934451 kB) is larger than allowed size 79872 kB
Comment 1 Mathieu Dubois-Briand 2025-12-08 10:17:56 UTC
oe-selftest-debian ubuntu2510-vk-1 master completed at 2025-12-05 02:41:34+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/2797/steps/15/logs/stdio
Comment 2 Mathieu Dubois-Briand 2025-12-09 11:20:48 UTC
So the failure on wic.Wic.test_grub_install_pcbios is easy to fix, this is again some issue with `du` parameters, I missed some occurrences in my previous fix. I will send a new patch.


The archiver.Archiver.test_archiver_mode_mirror_gitsm one is because of failure to copy permissions:

Exception: subprocess.CalledProcessError: Command 'cp -fpPRH /srv/autobuilder/valkyrie.yocto.io/current_sources/git2_git.yoctoproject.org.git-submodule-test.tar.gz /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-2655469/tmp/work/x86-64-v3-poky-linux/git-submodule-test/1.0/archiver-sources/mirror' returned non-zero exit status 1.

I can reproduce it on the worker, and minimal failing command is:
cp  /srv/autobuilder/valkyrie.yocto.io/current_sources/git2_git.yoctoproject.org.git-submodule-test.tar.gz . --preserve=mode

It looks like we have extend attributes on this file:
ls -l /srv/autobuilder/valkyrie.yocto.io/current_sources/git2_git.yoctoproject.org.git-submodule-test.tar.gz 
-rw-r--r--+ 1 pokybuild pokybuild 13782 Nov 21  2024 /srv/autobuilder/valkyrie.yocto.io/current_sources/git2_git.yoctoproject.org.git-submodule-test.tar.gz

Yet getfacl does not show anything specific. I checked on some other worker (debian13-vk-1), and the same file does not show extended attributes in there.

I will ask the helpdesk about anything specific on this worker.


About the devtool.DevtoolDeployTargetTests.test_devtool_deploy_target failure, I still have to understand what's going on. I did not reproduce it locally.
Comment 3 Mathieu Dubois-Briand 2025-12-10 13:09:59 UTC
oe-selftest-debian ubuntu2510-vk-1 master completed at 2025-12-09 10:27:32+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/2807/steps/15/logs/stdio
Comment 4 Randy MacLeod 2025-12-11 15:51:56 UTC
Michael, 
Did you seem the mail about extended attributes? Any progress?
Comment 5 Randy MacLeod 2025-12-11 15:52:23 UTC
Related mathieu patches:
[PATCH] wic: Remove conflicting du parameters
https://lists.openembedded.org/g/openembedded-core/message/226723
[PATCH] wic: Remove more conflicting du parameters
https://lists.openembedded.org/g/openembedded-core/message/227443
Comment 6 Mathieu Dubois-Briand 2025-12-12 11:12:41 UTC
So I finally reproduced the  devtool.DevtoolDeployTargetTests.test_devtool_deploy_target failure, even locally.

The problem is pseudo is showing this "couldn't allocate absolute path for 'null'." message to stderr, and the test code is trying to parse that as part of the `ls` output.

I did open a separate issue for the behavior of ls while used in pseudo:
https://bugzilla.yoctoproject.org/show_bug.cgi?id=16099

Now, the test only fails because it parses both stdout and stderr. If it was ignoring stderr, it would succeed. I can rewrite the parsing code in that way, but I do have mixed feelings about that. Any opinion?
Comment 7 Mathieu Dubois-Briand 2025-12-12 12:14:20 UTC
oe-selftest-debian ubuntu2510-vk-1 master completed at 2025-12-11 12:34:56+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/2815/steps/15/logs/stdio
Comment 8 Randy MacLeod 2025-12-12 15:03:31 UTC
 > Now, the test only fails because it parses both stdout and stderr. 
 > If it was ignoring stderr, it would succeed. I can rewrite the 
 > parsing code in that way, but I do have mixed feelings about that.
 >  Any opinion?

I guess you're asking Michael but I'll chime in anyway! 

That's a work-around not a fix. 
Since ubu-25.10 is not actively being tested, don't do it.

If fixing ubu-25.10 ( pseudo with uutils ) takes too long,
I guess this could be a 'short-term' work-around but there should be a bug opened to track reverting it.
Comment 9 Mathieu Dubois-Briand 2025-12-17 13:06:48 UTC
This is a good news: the extended attributes issue is gone, the only remaining
one is the pseudo issue.

oe-selftest-debian ubuntu2510-vk-1 master completed at 2025-12-16 22:12:27+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/2840/steps/15/logs/stdio
Comment 10 Mathieu Dubois-Briand 2025-12-17 13:08:59 UTC
Closing this one, the issue with pseudo is tracked in a separate issue: https://bugzilla.yoctoproject.org/show_bug.cgi?id=16099