Bug 13290

Summary: elfutils ptest results are inconsistent per image
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Joshua Watt <JPEWhacker>
Component: coreAssignee: Mingli Yu <mingli.yu>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: meta.mr.watcher, meta.watcher, randy.macleod
Version: 2.7   
Target Milestone: 2.8 M1   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
ptest log from core-image-sato build
none
ptest log from core-image-sato-sdk build none

Description Joshua Watt 2019-04-18 18:14:30 UTC 
elfutils is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
elfutils                     | 31          | 6        | 166       | 

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
elfutils                     | 31          | 4        | 168       |
Comment 1 Joshua Watt 2019-04-18 18:15:04 UTC 
Created attachment 4483 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:15:29 UTC 
Created attachment 4484 [details]
ptest log from core-image-sato-sdk build
Comment 3 Mingli Yu 2019-05-15 08:31:45 UTC 
 Hi Joshua Watt,

There is some fix for elfutils ptest as https://git.openembedded.org/openembedded-core/commit/?id=7ff76b86299289a4a5741f910399d95232f64f32, could you help to rerun the test?
Comment 4 Mingli Yu 2019-05-17 06:07:02 UTC 
Currently:
core-image-sato report:
25 of 197 tests failed
(6 tests were not run)

core-image-sato-sdk report:
23 of 199 tests failed
(4 tests were not run)

This is because below 4 cases PASS for core-image-sato-sdk as gcc available.
PASS: run-strip-nothing.sh
PASS: run-strip-g.sh
PASS: run-disasm-x86.sh
PASS: run-disasm-x86-64.sh

And correspondingly, the above 4 cases for core-image-sato behaves 2 cases SKIP and 2 cases FAIL as gcc unavailable as below:
which: no gcc in (/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin)
SKIP: run-strip-nothing.sh
which: no gcc in (/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin)
SKIP: run-strip-g.sh
./run-disasm-x86.sh: line 25: gcc: command not found                                                                                          
FAIL: run-disasm-x86.sh
./run-disasm-x86-64.sh: line 25: gcc: command not found

So basically, the elfutils ptest results should be consistent if no gcc gap.
Comment 5 Randy MacLeod 2019-05-24 16:05:12 UTC 
Adding gcc as a dependency is an option. Commit currently in master-next:

commit b8373f3a213f2001d4c698d56f02f6c0e7a36c3c
Author: Richard Purdie <richard.purdie@linuxfoundation.org>
Date:   Mon Apr 29 13:00:37 2019 +0100

    elfutils: Add gcc to ptest RDEPENDS
    
    Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>

diff --git a/meta/recipes-devtools/elfutils/elfutils_0.176.bb b/meta/recipes-devtools/elfutils/elfutils_0.176.bb
index fb2868723a..1362f4e42d 100644
--- a/meta/recipes-devtools/elfutils/elfutils_0.176.bb
+++ b/meta/recipes-devtools/elfutils/elfutils_0.176.bb
@@ -43,8 +43,7 @@ inherit autotools gettext ptest
 
 EXTRA_OECONF = "--program-prefix=eu- --without-lzma"
 EXTRA_OECONF_append_class-native = " --without-bzlib"
-# gcc has been added to blacklist, we will find workaround solution
-RDEPENDS_${PN}-ptest = "libasm libelf bash"
+RDEPENDS_${PN}-ptest = "libasm libelf bash gcc"
 
 EXTRA_OECONF_append_class-target += "--enable-tests-rpath"
Comment 6 Richard Purdie 2019-05-30 14:52:16 UTC 
The gcc dependency isn't quite right, it needs to be gcc-symlinks and may involve some binutils and some other pieces (maybe libgcc).