Bug 13291 - flex ptest results are inconsistent per image
Summary: flex ptest results are inconsistent per image
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.7
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 2.8 M2
Assignee: Sakib Sajal
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2019-04-18 18:17 UTC by Joshua Watt
Modified: 2019-07-16 15:03 UTC (History)
4 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
ptest log from core-image-sato build (250 bytes, text/x-log)
2019-04-18 18:18 UTC, Joshua Watt
no flags Details
ptest log from core-image-sato-sdk build (22.89 KB, text/x-log)
2019-04-18 18:18 UTC, Joshua Watt
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Watt 2019-04-18 18:17:33 UTC
flex is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
flex                         | 0           | 0        | 0         |

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
flex                         | 114         | 0        | 0         | 

Notably, no tests are run at all in the core-image-sato case.
Comment 1 Joshua Watt 2019-04-18 18:18:16 UTC
Created attachment 4485 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:18:32 UTC
Created attachment 4486 [details]
ptest log from core-image-sato-sdk build
Comment 3 Sakib Sajal 2019-07-16 15:03:10 UTC
I have built both core-image-sato and core-image-sato-sdk and ran the flex ptest which gave me consistent results, tests on both the images passed.

Also I noticed the following commit which might have fixed the issue

$ git log --since="2019-04-18" ./meta/recipes-devtools/flex 

commit fd87837e367049fb58b2941dbf46a83729a7866a
Author: Richard Purdie <richard.purdie@linuxfoundation.org>
Date:   Thu May 16 12:45:01 2019 +0100

    gettext/flex/m4/bzip2/gzip/parted/slang/attr: Add make to -ptest packages
    
    This solves ptest runtime errors where make was missing causing the ptests
    to fail.
    
    (From OE-Core rev: 2ade2c53388c92d36b8b30dae30670fd96ca4821)
    
    Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>