Bug 14213

Summary: gawk ptest intermittent failure
Product: [QA/Testing] Package Testing (ptest) Reporter: Alexandre Belloni <alexandre.belloni>
Component: ptestAssignee: Yi Fan Yu <yf3yu>
Status: RESOLVED WONTFIX QA Contact:
Severity: normal    
Priority: Medium+ CC: randy.macleod
Version: 3.3   
Target Milestone: 3.4 M1   
Hardware: x86   
OS: arm64   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Alexandre Belloni 2021-02-01 21:56:33 UTC
WARNING: core-image-sato-ptest-fast-1.0-r0 do_testimage: There were failing ptests.
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner
    self.fail(failmsg)
AssertionError: Failed ptests:
{'gawk': ['timeout']}

Full log is here:
https://autobuilder.yoctoproject.org/typhoon/#/builders/93/builds/800/steps/12
Comment 1 Randy MacLeod 2021-02-04 15:49:12 UTC
Not fixed by the ptest timeout increase.
Comment 2 Yi Fan Yu 2021-03-09 16:00:31 UTC
bumping to m4
Comment 3 Alexandre Belloni 2021-03-11 14:30:32 UTC
This was ubuntu1804-arm-1
Comment 4 Yi Fan Yu 2021-04-22 22:08:31 UTC
basically we run in gawk `(sleep 1; echo bye) | readline`
but readline  is set to timeout after 400ms and retry again.

The test expects the retry to happen twice (succeed on third one) but it only happened once.

https://autobuilder.yocto.io/pub/non-release/20210201-1/testresults/qemuarm64-ptest-fast/gawk.log


this is similar to what python ptest saw relatively recently on the arm host.
i disabled some of the timing related test:
https://git.openembedded.org/openembedded-core/commit/?id=7c67bc2476b784083acbc7a55ecf3627ec8f2b6b


root cause is probably in the overloaded arm64 host.
Comment 5 Yi Fan Yu 2021-04-23 13:36:23 UTC
It hasn't occurred for 2 months, this was an evidence of a system slow-down of more than 200ms.

If it happens again, my suggestion would be turning off the ptest on arm hosts, since 200ms of slack is pretty generous.