Bug 13292 - gzip ptest results are inconsistent per image
Summary: gzip ptest results are inconsistent per image
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.7
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 2.8 M3
Assignee: Trevor Gamblin
QA Contact:
URL:
Whiteboard: NEWCOMER
Depends on:
Blocks:
 
Reported: 2019-04-18 18:20 UTC by Joshua Watt
Modified: 2019-09-16 18:07 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
ptest log from core-image-sato build (1.34 KB, text/x-log)
2019-04-18 18:20 UTC, Joshua Watt
no flags Details
ptest log from core-image-sato-sdk build (1005 bytes, text/x-log)
2019-04-18 18:20 UTC, Joshua Watt
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Watt 2019-04-18 18:20:00 UTC
gzip is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
gzip                         | 3           | 19       | 0         | 

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
gzip                         | 22          | 0        | 0         |
Comment 1 Joshua Watt 2019-04-18 18:20:27 UTC
Created attachment 4487 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:20:41 UTC
Created attachment 4488 [details]
ptest log from core-image-sato-sdk build
Comment 3 Richard Purdie 2019-05-30 14:23:48 UTC
This has been partly fixed, minimal images now show 19 tests passing and 3 skipped. We need to find out why those 3 are skipped in minimal images and likely add the missing dependencies.
Comment 4 Trevor Gamblin 2019-08-06 19:06:08 UTC
The core-image-sato build was skipping the tests for the following:

- zgrep-context
- zdiff
- zgrep-signal

while core-image-sato-sdk passed them. The skip messages (in order) are as follows:

- zgrep-context: grep does not support context options; skipping this test
- zdiff: skipped test: diff output format is incompatible with POSIX
- zgrep-signal: skipped test: no suitable perl found

The issue was that grep and diff are both provided by BusyBox in core-image-sato, while with zgrep-signal the perl and perl-ptest packages were required. Patch has been submitted to oe-core.
Comment 5 Trevor Gamblin 2019-09-16 18:07:25 UTC
Was fixed but not updated. Link to commit in oe-core: http://cgit.openembedded.org/openembedded-core/commit/?id=c2559ab9b41b823b23dc675745bbaefd45362a08