Bug 14165

Summary: AB-INT PTEST: strace ptest intermittent failure in qual_fault-syscall.test
Product: [QA/Testing] Package Testing (ptest) Reporter: Naveen Saini <naveen.kumar.saini>
Component: ptestAssignee: Randy MacLeod <randy.macleod>
Status: RESOLVED WORKSFORME QA Contact:
Severity: normal    
Priority: Medium CC: alexandre.belloni, chee.yang.lee, joaomarcos.costa, jon.mason, randy.macleod, ross.burton
Version: 3.3   
Target Milestone: 5.2   
Hardware: x86   
OS: arm64   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Naveen Saini 2020-12-28 07:44:35 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1359
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1364

AssertionError: Failed ptests:
{'strace': ['qual_fault-syscall.test', 'qual_fault.test']}
Comment 1 Naveen Saini 2021-01-06 06:51:01 UTC
Observed same ptest failure with qemux86-64 too (master-next)

AssertionError: Failed ptests:
{'strace': ['qual_fault-syscall.test', 'qual_fault.test']}

https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/1647
Comment 2 Chee Yang 2021-01-21 03:38:12 UTC
i think these should be same issue 
Worker: ubuntu2004-arm-1
master

WARNING: core-image-sato-sdk-ptest-1.0-r0 do_testimage: There were failing ptests.
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner
    self.fail(failmsg)
AssertionError: Failed ptests:
{'strace': ['qual_fault.test']}

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/1439/steps/12/logs/stdio
Comment 3 Yi Fan Yu 2021-01-26 19:40:54 UTC
tried to reproduce on qemux86-64:
tests/qual_fault.log:qual_fault.test: failed test: time limit (120) exceeded 

Attempted to raise the timeout limit to 1200s and test passed.

same for qual_fault_syscall
Comment 4 Randy MacLeod 2021-01-26 20:01:04 UTC
1200 s is a bit long. How about 2x the actual time required?
Comment 5 Yi Fan Yu 2021-01-27 19:33:51 UTC
2x was implemented so 240s (4min) for timeout
Comment 6 Randy MacLeod 2021-01-27 20:08:27 UTC
Please add a link to the commit so that people can see the change for themselves.
Comment 8 Randy MacLeod 2021-01-28 15:35:43 UTC
*** Bug 14197 has been marked as a duplicate of this bug. ***
Comment 9 Randy MacLeod 2021-01-28 15:36:16 UTC
*** Bug 14198 has been marked as a duplicate of this bug. ***
Comment 10 Chee Yang 2021-05-12 11:59:30 UTC
happened again 
 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2079/steps/12/logs/stdio
qemux86-64-ptest
fedora33-ty-1
Comment 11 Alexandre Belloni 2021-06-30 22:54:43 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2214/steps/12/logs/stdio

qemux86-64-ptest fedora33-ty-1
Comment 12 Alexandre Belloni 2021-08-11 14:58:07 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/2061/steps/12/logs/stdio

qemuarm64-ptest ubuntu2004-arm-1
Comment 13 Alexandre Belloni 2021-09-16 09:04:53 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/2147/steps/12/logs/stdio

qemuarm64-ptest ubuntu2004-arm-1
Comment 14 Alexandre Belloni 2021-09-16 10:34:08 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/2172/steps/12/logs/stdio

qemuarm64-ptest ubuntu2004-arm-1
Comment 15 Alexandre Belloni 2021-09-23 13:22:45 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2555/steps/12/logs/stdio
qemux86-64-ptest debian10-ty-3
Comment 16 Randy MacLeod 2022-03-03 15:48:54 UTC
Not seen in months and strace tests are run frequently.
Comment 17 Alexandre Belloni 2022-12-22 14:34:16 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/4205/steps/12/logs/stdio

qemuarm64-ptest ubuntu2004-arm-1

'strace': ['trace_statfs.gen.test',
            'qual_fault-syscall.test',
            'trace_statfs.gen',
            'qual_fault-syscall'],
Comment 18 Randy MacLeod 2022-12-22 15:52:24 UTC
Need to update to strace-6.1 as well.
Comment 19 Alexandre Belloni 2023-01-11 21:57:45 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/4343/steps/12/logs/stdio
qemuarm64-ptest ubuntu2004-arm-1
Comment 20 Alexandre Belloni 2023-03-30 13:08:53 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/4653/steps/12/logs/stdio

qemuarm64-ptest ubuntu2004-arm-1
Comment 21 João Marcos Costa 2024-01-17 15:43:39 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5562/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 22 João Marcos Costa 2024-02-22 14:34:31 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6087/steps/12/logs/stdio

Failed ptests:
{'strace': ['qual_fault-syscall.test',
            'qual_fault.test',
            'qual_fault-syscall',
            'qual_fault']}

qemuarm64-ptest ubuntu2004-arm-1
Comment 23 João Marcos Costa 2024-04-03 12:50:00 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6261/steps/13/logs/stdio

Failed ptests:
{'strace': ['qual_fault-syscall.test',
            'qual_fault.test',
            'qual_fault-syscall',
            'qual_fault']}

qemuarm64-ptest ubuntu1804-arm-1
Comment 24 João Marcos Costa 2024-06-18 08:04:16 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6544/steps/12/logs/stdio

AssertionError: 
Failed ptests:
{'strace': ['filtering_syscall-syntax.test',
            'qual_fault-syscall.test',
            'filtering_syscall-syntax',
            'qual_fault-syscall']}

qemuarm64-ptest ubuntu2204-arm-1
Comment 25 João Marcos Costa 2024-06-24 13:02:03 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6567/steps/12/logs/stdio

qemuarm64-ptest ubuntu2004-arm-1
Comment 26 João Marcos Costa 2024-08-19 12:06:02 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6688/steps/12/logs/stdio

qemuarm64-ptest ubuntu2004-arm-1
Comment 27 Randy MacLeod 2025-01-23 15:52:48 UTC
Not seen recently or on the new AB cluster.