Bug 13292

Summary: gzip ptest results are inconsistent per image
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Joshua Watt <JPEWhacker>
Component: coreAssignee: Trevor Gamblin <tvgamblin>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: denis, meta.mr.watcher, meta.watcher, randy.macleod, richard.purdie
Version: 2.7   
Target Milestone: 2.8 M3   
Hardware: x86   
OS: Multiple   
Whiteboard: NEWCOMER
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
ptest log from core-image-sato build
none
ptest log from core-image-sato-sdk build none

Description Joshua Watt 2019-04-18 18:20:00 UTC 
gzip is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
gzip                         | 3           | 19       | 0         | 

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
gzip                         | 22          | 0        | 0         |
Comment 1 Joshua Watt 2019-04-18 18:20:27 UTC 
Created attachment 4487 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:20:41 UTC 
Created attachment 4488 [details]
ptest log from core-image-sato-sdk build
Comment 3 Richard Purdie 2019-05-30 14:23:48 UTC 
This has been partly fixed, minimal images now show 19 tests passing and 3 skipped. We need to find out why those 3 are skipped in minimal images and likely add the missing dependencies.
Comment 4 Trevor Gamblin 2019-08-06 19:06:08 UTC 
The core-image-sato build was skipping the tests for the following:

- zgrep-context
- zdiff
- zgrep-signal

while core-image-sato-sdk passed them. The skip messages (in order) are as follows:

- zgrep-context: grep does not support context options; skipping this test
- zdiff: skipped test: diff output format is incompatible with POSIX
- zgrep-signal: skipped test: no suitable perl found

The issue was that grep and diff are both provided by BusyBox in core-image-sato, while with zgrep-signal the perl and perl-ptest packages were required. Patch has been submitted to oe-core.
Comment 5 Trevor Gamblin 2019-09-16 18:07:25 UTC 
Was fixed but not updated. Link to commit in oe-core: http://cgit.openembedded.org/openembedded-core/commit/?id=c2559ab9b41b823b23dc675745bbaefd45362a08