Bug 13595 - [QA 3.0 RC2] strace failure in ptest
Summary: [QA 3.0 RC2] strace failure in ptest
Status: RESOLVED FIXED
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: 3.0
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 3.1 M2
Assignee: Randy MacLeod
QA Contact:
URL:
Whiteboard: BACKPORT 3.0.1
Depends on:
Blocks:
 
Reported: 2019-10-15 04:09 UTC by Sudhir Sharma
Modified: 2020-01-29 01:13 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
regression_results (37.13 KB, text/plain)
2019-10-15 04:09 UTC, Sudhir Sharma
no flags Details
3.0_RC2_Report (20.19 KB, text/plain)
2019-10-15 04:10 UTC, Sudhir Sharma
no flags Details
2.8_M3_RC1_Report (20.23 KB, text/plain)
2019-10-15 04:11 UTC, Sudhir Sharma
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Sudhir Sharma 2019-10-15 04:09:12 UTC
Created attachment 4579 [details]
regression_results

ptest regression results

We took ptest results from autobuilder and did ptest regression. 

1. Download ptest results for current and previous release.
2. Run resulttool regression for ptest
3. Identify test that passed previous release and failed  this release

Previous release 
https://autobuilder.yocto.io/pub/releases/yocto-2.8_M3.rc1/testresults/qemux86-64-ptest/

Current release
https://autobuilder.yocto.io/pub/releases/yocto-3.0.rc2/testresults/qemux86-64-ptest/ 

We have observed failure in ptest regression results.

Strace
ptestresult.strace.delay.test: FAILED -> PASSED
ptestresult.strace.syslog.gen.test: FAILED -> PASSED

Attaching failure log for strace.
Comment 1 Sudhir Sharma 2019-10-15 04:10:12 UTC
Created attachment 4580 [details]
3.0_RC2_Report
Comment 2 Sudhir Sharma 2019-10-15 04:11:10 UTC
Created attachment 4581 [details]
2.8_M3_RC1_Report
Comment 4 Randy MacLeod 2020-01-29 01:13:11 UTC
Yes, that seems to fix the strace tests:
Using oe-core commit:
9031b66c7c (HEAD -> master, origin/master, origin/HEAD) grep: Fix shell after autotools changes

and
MACHINE ??= "qemux86-64"
DISTRO_FEATURES_append = " ptest"
IMAGE_ROOTFS_EXTRA_SPACE  = "100000000"
EXTRA_IMAGE_FEATURES ?= "debug-tweaks"
IMAGE_INSTALL_append = " strace-ptest"

for both:
   core-image-minimal/qemux86-64/kvm
   core-image-sato/qemux86-64/kvm

$ egrep 'delay.test|syslog.gen.test' /tmp/strace-cim-jan-28.log
PASS: syslog.gen.test
PASS: delay.test

and FYI:
============================================================================
Testsuite summary for strace 5.4
============================================================================
# TOTAL: 721
# PASS:  560
# SKIP:  161
# XFAIL: 0
# FAIL:  0
# XPASS: 0
# ERROR: 0

----