Bug 13291

Summary: flex ptest results are inconsistent per image
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Joshua Watt <JPEWhacker>
Component: coreAssignee: Sakib Sajal <sakib.sajal>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: meta.mr.watcher, meta.watcher, randy.macleod, sakib.sajal
Version: 2.7   
Target Milestone: 2.8 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
ptest log from core-image-sato build
none
ptest log from core-image-sato-sdk build none

Description Joshua Watt 2019-04-18 18:17:33 UTC 
flex is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
flex                         | 0           | 0        | 0         |

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
flex                         | 114         | 0        | 0         | 

Notably, no tests are run at all in the core-image-sato case.
Comment 1 Joshua Watt 2019-04-18 18:18:16 UTC 
Created attachment 4485 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:18:32 UTC 
Created attachment 4486 [details]
ptest log from core-image-sato-sdk build
Comment 3 Sakib Sajal 2019-07-16 15:03:10 UTC 
I have built both core-image-sato and core-image-sato-sdk and ran the flex ptest which gave me consistent results, tests on both the images passed.

Also I noticed the following commit which might have fixed the issue

$ git log --since="2019-04-18" ./meta/recipes-devtools/flex 

commit fd87837e367049fb58b2941dbf46a83729a7866a
Author: Richard Purdie <richard.purdie@linuxfoundation.org>
Date:   Thu May 16 12:45:01 2019 +0100

    gettext/flex/m4/bzip2/gzip/parted/slang/attr: Add make to -ptest packages
    
    This solves ptest runtime errors where make was missing causing the ptests
    to fail.
    
    (From OE-Core rev: 2ade2c53388c92d36b8b30dae30670fd96ca4821)
    
    Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>