Bug 14164 - libinput arm ptest intermittent failure
Summary: libinput arm ptest intermittent failure
Status: RESOLVED FIXED
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: 3.3
Hardware: x86 arm64
: Medium+ normal
Target Milestone: 3.3 M3
Assignee: Ross Burton
QA Contact:
URL:
Whiteboard: AB-INT
Depends on:
Blocks:
 
Reported: 2020-12-28 07:42 UTC by Naveen Saini
Modified: 2021-03-12 14:17 UTC (History)
7 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Naveen Saini 2020-12-28 07:42:07 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1359
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1364

AssertionError: Failed ptests:
{'libinput': ['libinput-test-suite']}
Comment 3 Minjae Kim 2021-02-08 04:29:32 UTC
Happened again:

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1500/steps/12/logs/stdio

WARNING: core-image-sato-sdk-ptest-1.0-r0 do_testimage: There were failing ptests.
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner
    self.fail(failmsg)
AssertionError: Failed ptests:
{'libinput': ['libinput-test-suite'], 'quilt': ['patch-wrapper.test']}
Comment 15 Ross Burton 2021-03-03 21:34:36 UTC
Discussed this with upstream.

The test suite is time sensitive.  It should be ran on idle machines to ensure it runs fine.

We can't do that, so I'm trying to reduce parallellism in the test suite to see if that helps.
Comment 16 Alexandre Belloni 2021-03-11 14:24:24 UTC
So far, it happened 20 out of 21 times on ubuntu1804-arm-1, and one time on centos8-ty-2 and this was alongside 'valgrind': ['gdbserver_tests/nlcontrolc']
Comment 17 Ross Burton 2021-03-12 14:17:11 UTC
We're not running this automatically anymore.
(oe-core 54e2eb809bdfedb64219f37b82589372bbc96905)