Bug 13295 - openssh ptest results are inconsistent per image
Summary: openssh ptest results are inconsistent per image
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.7
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 2.8 M1
Assignee: Armin Kuster
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2019-04-18 18:27 UTC by Joshua Watt
Modified: 2019-06-08 15:07 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)

Attachments
ptest log from core-image-sato build (5.32 KB, text/x-log)
2019-04-18 18:28 UTC, Joshua Watt 		no flags Details
ptest log from core-image-sato-sdk build (89.82 KB, text/x-log)
2019-04-18 18:28 UTC, Joshua Watt 		no flags Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Watt 2019-04-18 18:27:33 UTC 
openssh is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
openssh                      | 0           | 0        | 1         | 

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
openssh                      | 67          | 0        | 3         | 

Notable, only one test was even attempted in the core-image-sato case
Comment 1 Joshua Watt 2019-04-18 18:28:12 UTC 
Created attachment 4493 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:28:28 UTC 
Created attachment 4494 [details]
ptest log from core-image-sato-sdk build
Comment 3 Richard Purdie 2019-06-05 22:00:08 UTC 
With current master:

autobuilder:

openssh                      | 67          | 0        | 3         | 1016

minimal image:

openssh                      | 15          | 1       | 1         | 145

so there are issues remaining.
Comment 4 Richard Purdie 2019-06-05 22:02:01 UTC 
Quick glance at the logs looks like a missing coreutils RDEPENDS
Comment 5 Richard Purdie 2019-06-06 22:28:03 UTC 
There is one test different with the coreutils patch on the mailing list.
Comment 6 Richard Purdie 2019-06-07 16:50:09 UTC 
The other change is one test is skipped in minimal images due to gdb not being present. I'll likely just submit a patch documenting that as we don't really want that build dependency.
Comment 8 Richard Purdie 2019-06-08 15:07:52 UTC 
Skipped test now documented so ptest issues in openssh are resolved in master:
http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=3ef8d2175bf56290c8a96e1d13ef4a1952d86c42