Bug 13299 - quilt ptest results are inconsistent per image
Summary: quilt ptest results are inconsistent per image
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.7
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 2.8 M1
Assignee: Richard Purdie
QA Contact:
URL:
Whiteboard: NEWCOMER
Depends on:
Blocks:
 
Reported: 2019-04-18 18:37 UTC by Joshua Watt
Modified: 2019-06-02 12:24 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: Done (doc changes complete)

Attachments
ptest log from core-image-sato build (119.31 KB, text/x-log)
2019-04-18 18:37 UTC, Joshua Watt 		no flags Details
ptest log from core-image-sato-sdk build (22.96 KB, text/x-log)
2019-04-18 18:37 UTC, Joshua Watt 		no flags Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Watt 2019-04-18 18:37:05 UTC 
quilt is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
quilt                        | 23          | 34       | 0         | 

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
quilt                        | 57          | 0        | 0         |
Comment 1 Joshua Watt 2019-04-18 18:37:29 UTC 
Created attachment 4501 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:37:41 UTC 
Created attachment 4502 [details]
ptest log from core-image-sato-sdk build
Comment 3 Ross Burton 2019-04-25 14:44:44 UTC 
patch: invalid option -- 'd'          != patching file deleted2
BusyBox v1.30.1 (2019-04-17 14:03:59 UTC) multi-call binary. != patching file emptied2

quilt-ptest needs to depend on real patch, busybox almost-patch isn't sufficient.
Comment 4 Richard Purdie 2019-05-30 14:21:17 UTC 
We've fixed a number of the dependencies.

The remaining issues look like perl module dependency problems. If you install quilt-ptest into a core-image-minimal image only about half the tests pass, the remainder look like perl module dependency problems.
Comment 5 Richard Purdie 2019-06-02 12:24:01 UTC 
Fixed in http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=c1e844e2ebfea643ccd8581de1bf5874518c4065 and the preceeding perl module dependency fixes.