Bug 11658 - [krogoth] testimage multiple errors and skipped test present in WIC image (Minnowmax64/NUC)
Summary: [krogoth] testimage multiple errors and skipped test present in WIC image (Mi...
Status: VERIFIED NOTABUG
Alias: None
Product: BSPs
Classification: Build System, Metadata & Runtime
Component: bsps-tools (show other bugs)
Version: 2.1.3
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 2.1.3
Assignee: Juan Ramos
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2017-06-13 21:37 UTC by Juan Ramos
Modified: 2017-07-03 18:27 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
log.do_testimage_Minnowmax64 (11.29 KB, application/octet-stream)
2017-06-13 21:37 UTC, Juan Ramos
no flags Details
log.do_test_nuc (10.90 KB, application/octet-stream)
2017-06-13 21:41 UTC, oscar lopez arandas
no flags Details
LOG_MM32 (28.62 KB, text/plain)
2017-06-13 22:58 UTC, David Lopez Barriba
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Juan Ramos 2017-06-13 21:37:19 UTC
Created attachment 3812 [details]
log.do_testimage_Minnowmax64

STATUS: IDLE
BUILD: 2.1.3: rc1-fe7fb002216f7886d49942333ea6d8592339bb05
ENVIRONMENT: genericx86-64-WIC on MMAX64 and NUC6i5SYH
Build Configuration:
BB_VERSION        = "1.30.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "universal"
TARGET_SYS        = "x86_64-poky-linux"
MACHINE           = "genericx86-64"
DISTRO            = "poky"
DISTRO_VERSION    = "2.1.3"
TUNE_FEATURES     = "m64 core2"
TARGET_FPU        = ""
meta              
meta-poky         
meta-yocto-bsp    = "HEAD:fe7fb002216f7886d49942333ea6d8592339bb05"
STEPS TO REPRODUCE: 
1.- Clone poky and setup to run BSP automated test:
https://wiki.yoctoproject.org/wiki/Quality_Assurance_yocto_project#Steps_for_BSP_Automated_Testing

2.- Download and burn "mkefidisk-201706062011-sda.direct" image from: https://autobuilder.yocto.io/srv/autobuilder/autobuilder.yoctoproject.org/pub/releases/yocto-2.1.3.rc1/machines/genericx86-64/

3.- Boot the image in Minnowmax 64 and run:
$ bitbake core-image-sato-sdk -c testimage 

EXPECTED OUTCOME: All the tests successfully PASS
ACTUAL OUTCOME:
FAIL: test_syslog_running (oeqa.runtime.syslog.SyslogTest)
FAIL: test_connmand_running (oeqa.runtime.connman.ConnmanTest)
FAIL: test_xorg_running (oeqa.runtime.xorg.XorgTest)
FAIL: test_perl_exists (oeqa.runtime.perl.PerlTest)
FAIL: test_perl_works (oeqa.runtime.perl.PerlTest)
FAIL: test_gcc_compile (oeqa.runtime.gcc.GccCompileTest)
FAIL: test_gpp2_compile (oeqa.runtime.gcc.GccCompileTest)
FAIL: test_gpp_compile (oeqa.runtime.gcc.GccCompileTest)
FAIL: test_make (oeqa.runtime.gcc.GccCompileTest)
FAIL: test_ldd_exists (oeqa.runtime.ldd.LddTest)
FAILED (failures=10, skipped=5)

NOTE: same errors/skipped for Minnowx64 and NUC
Full logs attached.
Comment 1 oscar lopez arandas 2017-06-13 21:41:12 UTC
Created attachment 3813 [details]
log.do_test_nuc
Comment 2 David Lopez Barriba 2017-06-13 22:57:41 UTC
I found this in genericx86-WIC on MMAX32

error log attached
Comment 3 David Lopez Barriba 2017-06-13 22:58:30 UTC
Created attachment 3814 [details]
LOG_MM32
Comment 4 Libertad 2017-06-15 21:21:20 UTC
wic images are not suppose to be generated on Krogoth so this issue is invalid see also bug 11637 for more details.
Comment 5 Alejandro Hernandez 2017-06-19 20:23:27 UTC
The errors show the following information:

self.assertEqual(status, 0, msg="no syslogd process, ps output: %s" % self.target.run(oeRuntimeTest.pscmd)[1])
AssertionError: 1 != 0 : no syslogd process, ps output: ps: invalid option -- 'e'
BusyBox v1.24.1 (2017-06-06 18:04:10 UTC) multi-call binary.

Usage: ps

So this is saying that ps does not recognize the option "-e" for the command ps, and this is caused becuase the command ps (from busybox) does not support that option.

The command is declared on the oetest class as (on Krogoth):

setattr(oeRuntimeTest, "pscmd", "ps -ef" if oeTest.hasPackage("procps") else "ps") 

Whereas on master is declared as:

cmd = '%s  | grep -i [s]yslogd' % self.tc.target_cmds['ps']

Which does not causes an issue, so this has either been fixed already (which would imply a backport from master), or the testcase was not run correctly.
Comment 6 Juan Ramos 2017-07-03 18:26:37 UTC
WIC images are not tested on Krogoth, closing this one.
Comment 7 Juan Ramos 2017-07-03 18:27:58 UTC
Verified.