Bug 14164

Summary: libinput arm ptest intermittent failure
Product: [QA/Testing] Package Testing (ptest) Reporter: Naveen Saini <naveen.kumar.saini>
Component: ptestAssignee: Ross Burton <ross.burton>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: alexandre.belloni, flowergom, Jagadheesan_Duraisamy, jon.mason, leonardo.sandoval, randy.macleod, ross.burton
Version: 3.3   
Target Milestone: 3.3 M3   
Hardware: x86   
OS: arm64   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Naveen Saini 2020-12-28 07:42:07 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1359
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1364

AssertionError: Failed ptests:
{'libinput': ['libinput-test-suite']}
Comment 3 Minjae Kim 2021-02-08 04:29:32 UTC
Happened again:

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1500/steps/12/logs/stdio

WARNING: core-image-sato-sdk-ptest-1.0-r0 do_testimage: There were failing ptests.
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner
    self.fail(failmsg)
AssertionError: Failed ptests:
{'libinput': ['libinput-test-suite'], 'quilt': ['patch-wrapper.test']}
Comment 15 Ross Burton 2021-03-03 21:34:36 UTC
Discussed this with upstream.

The test suite is time sensitive.  It should be ran on idle machines to ensure it runs fine.

We can't do that, so I'm trying to reduce parallellism in the test suite to see if that helps.
Comment 16 Alexandre Belloni 2021-03-11 14:24:24 UTC
So far, it happened 20 out of 21 times on ubuntu1804-arm-1, and one time on centos8-ty-2 and this was alongside 'valgrind': ['gdbserver_tests/nlcontrolc']
Comment 17 Ross Burton 2021-03-12 14:17:11 UTC
We're not running this automatically anymore.
(oe-core 54e2eb809bdfedb64219f37b82589372bbc96905)