Bug 13299

Summary: quilt ptest results are inconsistent per image
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Joshua Watt <JPEWhacker>
Component: coreAssignee: Richard Purdie <richard.purdie>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: liezhi.yang, meta.mr.watcher, meta.watcher, randy.macleod, richard.purdie
Version: 2.7   
Target Milestone: 2.8 M1   
Hardware: x86   
OS: Multiple   
Whiteboard: NEWCOMER
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Done (doc changes complete)
Attachments:
Description Flags
ptest log from core-image-sato build
none
ptest log from core-image-sato-sdk build none

Description Joshua Watt 2019-04-18 18:37:05 UTC
quilt is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
quilt                        | 23          | 34       | 0         | 

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
quilt                        | 57          | 0        | 0         |
Comment 1 Joshua Watt 2019-04-18 18:37:29 UTC
Created attachment 4501 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:37:41 UTC
Created attachment 4502 [details]
ptest log from core-image-sato-sdk build
Comment 3 Ross Burton 2019-04-25 14:44:44 UTC
patch: invalid option -- 'd'          != patching file deleted2
BusyBox v1.30.1 (2019-04-17 14:03:59 UTC) multi-call binary. != patching file emptied2

quilt-ptest needs to depend on real patch, busybox almost-patch isn't sufficient.
Comment 4 Richard Purdie 2019-05-30 14:21:17 UTC
We've fixed a number of the dependencies.

The remaining issues look like perl module dependency problems. If you install quilt-ptest into a core-image-minimal image only about half the tests pass, the remainder look like perl module dependency problems.
Comment 5 Richard Purdie 2019-06-02 12:24:01 UTC
Fixed in http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=c1e844e2ebfea643ccd8581de1bf5874518c4065 and the preceeding perl module dependency fixes.