Bug 14244

Summary: AB-INT PTEST ARM: util-linux script:_size ptest failure
Product: [QA/Testing] Package Testing (ptest) Reporter: Jagadheesan <Jagadheesan_Duraisamy>
Component: ptestAssignee: Ross Burton <ross.burton>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: alexandre.belloni, kai.kang, kory.maincent, naveen.kumar.saini, randy.macleod, richard.purdie, ross.burton, weaverjs
Version: unspecified   
Target Milestone: 3.4 M3   
Hardware: x86   
OS: Multiple   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Don't know

Description Jagadheesan 2021-02-19 11:33:03 UTC
From:
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1542/steps/12/logs/stdio

AssertionError: Failed ptests:
{....,
 'util-linux': ['script:_size'],
Comment 5 Alexandre Belloni 2021-03-11 14:41:00 UTC
Happend 5 times on ubuntu1804-arm-1
Comment 6 Naveen Saini 2021-04-19 08:30:18 UTC
Happened on master-next (3.3):
machine: qemuarm64
worker: ubuntu1804-arm-1

AssertionError: Failed ptests:
{....,
 'util-linux': ['script:_size']}


https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1699
Comment 7 Alexandre Belloni 2021-05-06 12:26:57 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1746/steps/12/logs/stdio

qemuarm64
master on ubuntu1804-arm-1
Comment 8 Randy MacLeod 2021-05-20 15:25:02 UTC
Confirmed only on arm by Alex B.
We need to look at the test and decide if it's sensible or should be skipped.
Comment 9 Ross Burton 2021-05-20 15:58:04 UTC
This is tests/ts/script/options, subtest size:

ts_init_subtest "size"
$TS_HELPER_SCRIPT --output-limit 9 --command "echo 1:1234567890" $TS_OUTPUT </dev/null >/dev/null 2>&1
$TS_HELPER_SCRIPT -a -o 9 --command "echo 2:1234567890" $TS_OUTPUT </dev/null >/dev/null 2>&1
echo $? >> $TS_OUTPUT
ts_finalize_subtest

Looks like TS_HELPER_SCRIPT is 'script' so it's hard to see how that fails.
Comment 10 Ross Burton 2021-05-20 16:18:10 UTC
TS_HELPER_SCRIPT is test_script, which is a special binary built for the tests.

A working run involves most of the script tests being skipped as the util-linux-script package wasn't installed, but the options test working (as that binary is in util-linux-ptest).

A failing run has most script tests failing, but the options test fails.
Comment 11 Randy MacLeod 2021-06-23 15:47:32 UTC
Kai is not available so move to unassigned and to M3.
Comment 12 Ross Burton 2021-06-28 13:01:50 UTC
Patch on the list to actually execute the tests properly.  Hopefully this solves the weirdness.
Comment 13 Ross Burton 2021-07-08 15:13:19 UTC
Fixed in 720660b936b5523ec48a7c04712d10c88198e12c.