10902 – several wic unit tests on selftest fail if distro is poky-tiny

Bug 10902 - several wic unit tests on selftest fail if distro is poky-tiny

Summary: several wic unit tests on selftest fail if distro is poky-tiny

Status:	VERIFIED FIXED

Alias:	None

Product:	Build Testing
Classification:	QA/Testing
Component:	general (show other bugs)
Version:	2.3
Hardware:	x86 Multiple

Importance:	Medium+ normal
Target Milestone:	2.3 M4
Assignee:	Leonardo Sandoval Gonzalez
QA Contact:	oscar lopez arandas

URL:
Whiteboard:

Depends on:
Blocks:

Reported:	2017-01-09 17:10 UTC by Leonardo Sandoval Gonzalez
Modified:	2017-04-24 14:55 UTC (History)
CC List:	5 users (show)

See Also:
OS type for building Yocto:	---
Type of Regression:	---
Verified:
Documentation change:	No (bug/feature does not impact docs)

Attachments
one-self test -r wic (4.98 KB, application/octet-stream) 2017-04-17 18:10 UTC, oscar lopez arandas	no flags	Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description Leonardo Sandoval Gonzalez 2017-01-09 17:10:09 UTC

Some wic checks required certain image type, which is not supported by poky-tiny distro. Currently, these are the failing tests:

---snip---
    2017-01-06 15:24:51 -   test_alternate_output_dir (oeqa.selftest.wic.Wic) ... FAIL (77.935s)
    2017-01-06 15:28:40 -   test_iso_image (oeqa.selftest.wic.Wic) ... FAIL (121.263s)
    2017-01-06 15:31:18 -   test_mkefidisk (oeqa.selftest.wic.Wic) ... FAIL (5.267s)
    2017-01-06 15:31:23 -   test_mkgummidisk (oeqa.selftest.wic.Wic) ... FAIL (5.397s)
    2017-01-06 15:33:21 -   test_systemd_bootdisk (oeqa.selftest.wic.Wic) ... FAIL (5.399s)
---snip---

Comment 1 Leonardo Sandoval Gonzalez 2017-04-04 20:09:19 UTC

This is the full list:

    14:FAIL: test_bmap_long (oeqa.selftest.wic.Wic)
    321:FAIL: test_bmap_short (oeqa.selftest.wic.Wic)
    525:FAIL: test_bootloader_config (oeqa.selftest.wic.Wic)
    728:FAIL: test_build_artifacts (oeqa.selftest.wic.Wic)
    932:FAIL: test_build_image_name (oeqa.selftest.wic.Wic)
   1136:FAIL: test_build_rootfs_long (oeqa.selftest.wic.Wic)
   1340:FAIL: test_build_rootfs_short (oeqa.selftest.wic.Wic)
   1544:FAIL: test_compress_bzip2 (oeqa.selftest.wic.Wic)
   1748:FAIL: test_compress_gzip (oeqa.selftest.wic.Wic)
   1952:FAIL: test_compress_xz (oeqa.selftest.wic.Wic)
   2155:FAIL: test_createhelp (oeqa.selftest.wic.Wic)
   2358:FAIL: test_debug_long (oeqa.selftest.wic.Wic)
   2562:FAIL: test_debug_short (oeqa.selftest.wic.Wic)
   2766:FAIL: test_default_output_dir (oeqa.selftest.wic.Wic)
   2970:FAIL: test_exclude_path (oeqa.selftest.wic.Wic)
   3174:FAIL: test_exclude_path_errors (oeqa.selftest.wic.Wic)
   3377:FAIL: test_fixed_size (oeqa.selftest.wic.Wic)
   3580:FAIL: test_fixed_size_error (oeqa.selftest.wic.Wic)
   3782:FAIL: test_fs_types (oeqa.selftest.wic.Wic)
   3986:FAIL: test_gpt_image (oeqa.selftest.wic.Wic)
   4189:FAIL: test_help (oeqa.selftest.wic.Wic)
   4393:FAIL: test_help_create (oeqa.selftest.wic.Wic)
   4596:FAIL: test_help_kickstart (oeqa.selftest.wic.Wic)
   4800:FAIL: test_help_list (oeqa.selftest.wic.Wic)
   5004:FAIL: test_help_overview (oeqa.selftest.wic.Wic)
   5208:FAIL: test_help_plugins (oeqa.selftest.wic.Wic)
   5412:FAIL: test_image_bootpart_globbed (oeqa.selftest.wic.Wic)
   5616:FAIL: test_image_env (oeqa.selftest.wic.Wic)
   5820:FAIL: test_image_vars_dir_long (oeqa.selftest.wic.Wic)
   6023:FAIL: test_image_vars_dir_short (oeqa.selftest.wic.Wic)
   6227:FAIL: test_iso_image (oeqa.selftest.wic.Wic)
   6431:FAIL: test_kickstart_parser (oeqa.selftest.wic.Wic)
   6635:FAIL: test_list_images (oeqa.selftest.wic.Wic)
   6839:FAIL: test_list_source_plugins (oeqa.selftest.wic.Wic)
   7043:FAIL: test_listed_images_help (oeqa.selftest.wic.Wic)
   7246:FAIL: test_listhelp (oeqa.selftest.wic.Wic)
   7450:FAIL: test_mkefidisk (oeqa.selftest.wic.Wic)
   7654:FAIL: test_no_command (oeqa.selftest.wic.Wic)
   7858:FAIL: test_qemu (oeqa.selftest.wic.Wic)
   8062:FAIL: test_qemu_efi (oeqa.selftest.wic.Wic)
   8266:FAIL: test_qemux86_directdisk (oeqa.selftest.wic.Wic)
   8469:FAIL: test_rawcopy_plugin (oeqa.selftest.wic.Wic)
   8673:FAIL: test_rawcopy_plugin_qemu (oeqa.selftest.wic.Wic)
   8876:FAIL: test_rootfs_artifacts (oeqa.selftest.wic.Wic)
   9079:FAIL: test_rootfs_indirect_recipes (oeqa.selftest.wic.Wic)
   9283:FAIL: test_sdimage_bootpart (oeqa.selftest.wic.Wic)
   9487:FAIL: test_skip_build_check_long (oeqa.selftest.wic.Wic)
   9690:FAIL: test_skip_build_check_short (oeqa.selftest.wic.Wic)
   9893:FAIL: test_systemd_bootdisk (oeqa.selftest.wic.Wic)
  10096:FAIL: test_unsupported_subcommand (oeqa.selftest.wic.Wic)
  10300:FAIL: test_version (oeqa.selftest.wic.Wic)
  10504:FAIL: test_wic_image_type (oeqa.selftest.wic.Wic)
  10708:FAIL: test_wrong_compressor (oeqa.selftest.wic.Wic)
  10917:FAILED (failures=53)

Failing due to 

    179:| autoreconf: configure.ac: not using Gettext
    305:| checking for xgettext... no
    309:| configure: error: GNU gettext tools not found; required for intltool

Comment 2 Ross Burton 2017-04-04 20:19:21 UTC

What recipe is that failing?

Comment 3 Leonardo Sandoval Gonzalez 2017-04-05 14:30:03 UTC

(In reply to comment #2)
> What recipe is that failing?

no recipe, it is the wic test case, executed with 'oe-selftest -r wic'

Comment 4 Leonardo Sandoval Gonzalez 2017-04-05 20:06:47 UTC

The problem is coming when bitbaking wic-tools, executed at the setUpLocal function, failing on the configure step of one of its dependencies: systemd-boot. Poky-tiny uses sysvinit as distro features so this may be reason of the problem, but I am still identifying the root cause.


| checking for intltool-extract... /home/lsandov1/poky/build/tmp/work/i586-poky-linux-musl/systemd-boot/232-r0/recipe-sysroot-native/usr/bin/intltool-extract
| checking for xgettext... no
| checking for msgmerge... no
| checking for msgfmt... no
| checking for gmsgfmt... no
| configure: error: GNU gettext tools not found; required for intltool
| WARNING: /home/lsandov1/poky/build/tmp/work/i586-poky-linux-musl/systemd-boot/232-r0/temp/run.do_configure.787:1 exit 1 from 'exit 1'
| ERROR: Function failed: do_configure (log file is located at /home/lsandov1/poky/build/tmp/work/i586-poky-linux-musl/systemd-boot/232-r0/temp/log.do_configure.787)
ERROR: Task (/home/lsandov1/poky/meta/recipes-bsp/systemd-boot/systemd-boot_232.bb:do_configure) failed with exit code '1'
NOTE: Tasks Summary: Attempted 609 tasks of which 608 didn't need to be rerun and 1 failed.

Summary: 1 task failed:
  /home/lsandov1/poky/meta/recipes-bsp/systemd-boot/systemd-boot_232.bb:do_configure
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
lsandov1@yctb05:~/poky/build>

Comment 5 Leonardo Sandoval Gonzalez 2017-04-05 22:35:38 UTC

patch sent and being reviewed at
http://lists.openembedded.org/pipermail/openembedded-core/2017-April/135240.html

Comment 6 Leonardo Sandoval Gonzalez 2017-04-10 17:34:46 UTC

Patch merged into master: 2830cfec83c9daad8134c3b7227b1ce8b863abc8

Comment 7 oscar lopez arandas 2017-04-17 18:09:49 UTC

the wic test case, executed with 'one-self test -r wic' work with successfully

testimage: core-image-sato-core2-32.wic
 
Build Configuration:
BB_VERSION        = "1.33.3"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "universal"
TARGET_SYS        = "i686-poky-linux"
MACHINE           = "intel-core2-32"
DISTRO            = "poky"
DISTRO_VERSION    = "2.2+snapshot-20170417"
TUNE_FEATURES     = "m32 core2"
COMMIT: eff56e4f0d59b1d965a68e4f009b7f07717b7edd

    STEPS:
git clone git://git.yoctoproject.org/poky"

b)In poky directory checkout on the desired commit:

$ git checkout <commit-id>

3. Source the environment, from poky directory

 $ cd ~/poky 

$ source oe-init-build-env

4. Edit local.conf. PATH
 5. In ~poky/build directory, in command line, type the following commands:

$ bitbake rpm psplash run-postinsts
$ bitbake package-index

NOTE: After finishing the tasks, copy the image manifest (core-image-sato-sdk-genericx86.manifest) and the testdata.json (core-image-sato-sdk-genericx86.testdata.json) from autobuilder at the following path: "~poky/build/tmp/deploy/images/genericx86/" ( if "/tmp/deploy/images/genericx86" does not exist create new directories with this path)

$ bitbake core-image-sato-sdk -c testimage

$ oe-selftest -r wic

    EXPECTED OUTCOME:
the wic test case, executed with 'one-self test -r wic'fail.
 

    ACTUAL OUTCOME: the wic test case, executed with 'one-self test -r wic' work with successfully

    RESULTS  IN  ATTACHMENT

Comment 8 oscar lopez arandas 2017-04-17 18:10:46 UTC

Created attachment 3725 [details]
one-self test -r wic

Comment 9 Leonardo Sandoval Gonzalez 2017-04-24 14:42:52 UTC

(In reply to comment #7)
> the wic test case, executed with 'one-self test -r wic' work with
> successfully
> 
> testimage: core-image-sato-core2-32.wic
>  
> Build Configuration:
> BB_VERSION        = "1.33.3"
> BUILD_SYS         = "x86_64-linux"
> NATIVELSBSTRING   = "universal"
> TARGET_SYS        = "i686-poky-linux"
> MACHINE           = "intel-core2-32"
> DISTRO            = "poky"
> DISTRO_VERSION    = "2.2+snapshot-20170417"
> TUNE_FEATURES     = "m32 core2"
> COMMIT: eff56e4f0d59b1d965a68e4f009b7f07717b7edd
> 
>     STEPS:
> git clone git://git.yoctoproject.org/poky"
> 
> b)In poky directory checkout on the desired commit:
> 
> $ git checkout <commit-id>
> 
> 3. Source the environment, from poky directory
> 
>  $ cd ~/poky 
> 
> $ source oe-init-build-env
> 
> 4. Edit local.conf. PATH

Oscar, which was the included line? I belive you set DISTRO to poky-tiny, which is the only change to be done.


>  5. In ~poky/build directory, in command line, type the following commands:
> 
> $ bitbake rpm psplash run-postinsts
> $ bitbake package-index
> 
> NOTE: After finishing the tasks, copy the image manifest
> (core-image-sato-sdk-genericx86.manifest) and the testdata.json
> (core-image-sato-sdk-genericx86.testdata.json) from autobuilder at the
> following path: "~poky/build/tmp/deploy/images/genericx86/" ( if
> "/tmp/deploy/images/genericx86" does not exist create new directories with
> this path)
> 
> $ bitbake core-image-sato-sdk -c testimage
> 
> $ oe-selftest -r wic
> 
>     EXPECTED OUTCOME:
> the wic test case, executed with 'one-self test -r wic'fail.
>  
> 
>     ACTUAL OUTCOME: the wic test case, executed with 'one-self test -r wic'
> work with successfully
> 
>     RESULTS  IN  ATTACHMENT

Comment 10 oscar lopez arandas 2017-04-24 14:55:24 UTC

(In reply to comment #9)
> (In reply to comment #7)
> > the wic test case, executed with 'one-self test -r wic' work with
> > successfully
> > 
> > testimage: core-image-sato-core2-32.wic
> >  
> > Build Configuration:
> > BB_VERSION        = "1.33.3"
> > BUILD_SYS         = "x86_64-linux"
> > NATIVELSBSTRING   = "universal"
> > TARGET_SYS        = "i686-poky-linux"
> > MACHINE           = "intel-core2-32"
> > DISTRO            = "poky"
> > DISTRO_VERSION    = "2.2+snapshot-20170417"
> > TUNE_FEATURES     = "m32 core2"
> > COMMIT: eff56e4f0d59b1d965a68e4f009b7f07717b7edd
> > 
> >     STEPS:
> > git clone git://git.yoctoproject.org/poky"
> > 
> > b)In poky directory checkout on the desired commit:
> > 
> > $ git checkout <commit-id>
> > 
> > 3. Source the environment, from poky directory
> > 
> >  $ cd ~/poky 
> > 
> > $ source oe-init-build-env
> > 
> > 4. Edit local.conf. PATH
> 
> Oscar, which was the included line? I belive you set DISTRO to poky-tiny,
> which is the only change to be done.
> Sorry, the line included if it was distro to poky-tiny.
> 
> >  5. In ~poky/build directory, in command line, type the following commands:
> > 
> > $ bitbake rpm psplash run-postinsts
> > $ bitbake package-index
> > 
> > NOTE: After finishing the tasks, copy the image manifest
> > (core-image-sato-sdk-genericx86.manifest) and the testdata.json
> > (core-image-sato-sdk-genericx86.testdata.json) from autobuilder at the
> > following path: "~poky/build/tmp/deploy/images/genericx86/" ( if
> > "/tmp/deploy/images/genericx86" does not exist create new directories with
> > this path)
> > 
> > $ bitbake core-image-sato-sdk -c testimage
> > 
> > $ oe-selftest -r wic
> > 
> >     EXPECTED OUTCOME:
> > the wic test case, executed with 'one-self test -r wic'fail.
> >  
> > 
> >     ACTUAL OUTCOME: the wic test case, executed with 'one-self test -r wic'
> > work with successfully
> > 
> >     RESULTS  IN  ATTACHMENT