Bug 13839

Summary: apr ptest intermittent failure
Product: [QA/Testing] Package Testing (ptest) Reporter: Richard Purdie <richard.purdie>
Component: ptestAssignee: Jeremy A. Puhlman <jpuhlman>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: randy.macleod
Version: unspecified   
Target Milestone: 3.1 M4   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Comment 1 Richard Purdie 2020-03-19 14:47:23 UTC
Cannot run ptests with @expectedFailure as ptests are required to pass
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/runtime/cases/ptest.py", line 33, in test_ptestrunner_expectsuccess
    self.do_ptestrunner()
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest-fast/build/meta/lib/oeqa/runtime/cases/ptest.py", line 103, in do_ptestrunner
    self.fail(failmsg)
AssertionError: Failed ptests:
{'apr': ['testlock_1_of_6']}

We should be able to find the ptest logs on the autobuilder from this build too.
Comment 2 Jeremy A. Puhlman 2020-03-24 00:42:29 UTC
So I have been running testlock of and on since last Thursday with no luck in reproduction. Were I to venture a guess its likely:

test_timeoutmutex
test_timeoutcond

It doesn't appear the test is run with -v (which would at least give a line number as to which test failed).


However, testsock has at least every 30-40 runs failed(if running the full suite). And it looks like a timeout issue in the code. Not sure if bumping the sleep it is using would resolve the issue.
Comment 3 Jeremy A. Puhlman 2020-03-24 15:57:05 UTC
Adding screen to the image and running the ltp tests in the background to stress the system I am able to get both testsock and testlock to fail in the timer tests.

These are both highly dependant on the function returning in a specific amount of time if they run over the allotted time they fail. With virtualization and any other stresses on the system, these tests are going to randomly fail. My first inclination is to just disable them because they are likely not going to be consistent in a virtualized environment.
Comment 4 Jeremy A. Puhlman 2020-03-26 20:31:28 UTC
Initial cut at resolving this.
https://patchwork.openembedded.org/patch/171350/
Comment 5 Jeremy A. Puhlman 2020-03-30 17:42:29 UTC
Commit accepted in to master.

https://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=ab0dbfc034a596a9171ce00f34467bc42534f00a

Moving to resolved.