Bug 13290 - elfutils ptest results are inconsistent per image
Summary: elfutils ptest results are inconsistent per image
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.7
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 2.8 M1
Assignee: Mingli Yu
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2019-04-18 18:14 UTC by Joshua Watt
Modified: 2019-06-03 02:58 UTC (History)
3 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
ptest log from core-image-sato build (32.63 KB, text/x-log)
2019-04-18 18:15 UTC, Joshua Watt
no flags Details
ptest log from core-image-sato-sdk build (32.61 KB, text/x-log)
2019-04-18 18:15 UTC, Joshua Watt
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Watt 2019-04-18 18:14:30 UTC
elfutils is generating different ptest results between the core-image-sato and core-image-sato-sdk images. Specifically:

core-image-sato: https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
elfutils                     | 31          | 6        | 166       | 

core-image-sato-sdk: https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json

Recipe                       | Passed      | Failed   | Skipped   | 
elfutils                     | 31          | 4        | 168       |
Comment 1 Joshua Watt 2019-04-18 18:15:04 UTC
Created attachment 4483 [details]
ptest log from core-image-sato build
Comment 2 Joshua Watt 2019-04-18 18:15:29 UTC
Created attachment 4484 [details]
ptest log from core-image-sato-sdk build
Comment 3 Mingli Yu 2019-05-15 08:31:45 UTC
 Hi Joshua Watt,

There is some fix for elfutils ptest as https://git.openembedded.org/openembedded-core/commit/?id=7ff76b86299289a4a5741f910399d95232f64f32, could you help to rerun the test?
Comment 4 Mingli Yu 2019-05-17 06:07:02 UTC
Currently:
core-image-sato report:
25 of 197 tests failed
(6 tests were not run)

core-image-sato-sdk report:
23 of 199 tests failed
(4 tests were not run)

This is because below 4 cases PASS for core-image-sato-sdk as gcc available.
PASS: run-strip-nothing.sh
PASS: run-strip-g.sh
PASS: run-disasm-x86.sh
PASS: run-disasm-x86-64.sh

And correspondingly, the above 4 cases for core-image-sato behaves 2 cases SKIP and 2 cases FAIL as gcc unavailable as below:
which: no gcc in (/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin)
SKIP: run-strip-nothing.sh
which: no gcc in (/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin)
SKIP: run-strip-g.sh
./run-disasm-x86.sh: line 25: gcc: command not found                                                                                          
FAIL: run-disasm-x86.sh
./run-disasm-x86-64.sh: line 25: gcc: command not found

So basically, the elfutils ptest results should be consistent if no gcc gap.
Comment 5 Randy MacLeod 2019-05-24 16:05:12 UTC
Adding gcc as a dependency is an option. Commit currently in master-next:

commit b8373f3a213f2001d4c698d56f02f6c0e7a36c3c
Author: Richard Purdie <richard.purdie@linuxfoundation.org>
Date:   Mon Apr 29 13:00:37 2019 +0100

    elfutils: Add gcc to ptest RDEPENDS
    
    Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>

diff --git a/meta/recipes-devtools/elfutils/elfutils_0.176.bb b/meta/recipes-devtools/elfutils/elfutils_0.176.bb
index fb2868723a..1362f4e42d 100644
--- a/meta/recipes-devtools/elfutils/elfutils_0.176.bb
+++ b/meta/recipes-devtools/elfutils/elfutils_0.176.bb
@@ -43,8 +43,7 @@ inherit autotools gettext ptest
 
 EXTRA_OECONF = "--program-prefix=eu- --without-lzma"
 EXTRA_OECONF_append_class-native = " --without-bzlib"
-# gcc has been added to blacklist, we will find workaround solution
-RDEPENDS_${PN}-ptest = "libasm libelf bash"
+RDEPENDS_${PN}-ptest = "libasm libelf bash gcc"
 
 EXTRA_OECONF_append_class-target += "--enable-tests-rpath"
Comment 6 Richard Purdie 2019-05-30 14:52:16 UTC
The gcc dependency isn't quite right, it needs to be gcc-symlinks and may involve some binutils and some other pieces (maybe libgcc).