Bug 13595

Summary: [QA 3.0 RC2] strace failure in ptest
Product: [QA/Testing] Package Testing (ptest) Reporter: Sudhir Sharma <sharmasudhir>
Component: ptestAssignee: Randy MacLeod <randy.macleod>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: akuster808, randy.macleod
Version: 3.0   
Target Milestone: 3.1 M2   
Hardware: x86   
OS: Multiple   
Whiteboard: BACKPORT 3.0.1
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
regression_results
none
3.0_RC2_Report
none
2.8_M3_RC1_Report none

Description Sudhir Sharma 2019-10-15 04:09:12 UTC
Created attachment 4579 [details]
regression_results

ptest regression results

We took ptest results from autobuilder and did ptest regression. 

1. Download ptest results for current and previous release.
2. Run resulttool regression for ptest
3. Identify test that passed previous release and failed  this release

Previous release 
https://autobuilder.yocto.io/pub/releases/yocto-2.8_M3.rc1/testresults/qemux86-64-ptest/

Current release
https://autobuilder.yocto.io/pub/releases/yocto-3.0.rc2/testresults/qemux86-64-ptest/ 

We have observed failure in ptest regression results.

Strace
ptestresult.strace.delay.test: FAILED -> PASSED
ptestresult.strace.syslog.gen.test: FAILED -> PASSED

Attaching failure log for strace.
Comment 1 Sudhir Sharma 2019-10-15 04:10:12 UTC
Created attachment 4580 [details]
3.0_RC2_Report
Comment 2 Sudhir Sharma 2019-10-15 04:11:10 UTC
Created attachment 4581 [details]
2.8_M3_RC1_Report
Comment 4 Randy MacLeod 2020-01-29 01:13:11 UTC
Yes, that seems to fix the strace tests:
Using oe-core commit:
9031b66c7c (HEAD -> master, origin/master, origin/HEAD) grep: Fix shell after autotools changes

and
MACHINE ??= "qemux86-64"
DISTRO_FEATURES_append = " ptest"
IMAGE_ROOTFS_EXTRA_SPACE  = "100000000"
EXTRA_IMAGE_FEATURES ?= "debug-tweaks"
IMAGE_INSTALL_append = " strace-ptest"

for both:
   core-image-minimal/qemux86-64/kvm
   core-image-sato/qemux86-64/kvm

$ egrep 'delay.test|syslog.gen.test' /tmp/strace-cim-jan-28.log
PASS: syslog.gen.test
PASS: delay.test

and FYI:
============================================================================
Testsuite summary for strace 5.4
============================================================================
# TOTAL: 721
# PASS:  560
# SKIP:  161
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0

----