Bug 10902

Summary: several wic unit tests on selftest fail if distro is poky-tiny
Product: [QA/Testing] Build Testing Reporter: Leonardo Sandoval Gonzalez <leonardo.sandoval.gonzalez>
Component: generalAssignee: Leonardo Sandoval Gonzalez <leonardo.sandoval.gonzalez>
Status: VERIFIED FIXED QA Contact: oscar lopez arandas <oscarx.lopez.arandas>
Severity: normal    
Priority: Medium+ CC: alejandro.hernandez, benjamin.esquivel, eduard.bartosh, jose.perez.carranza, ross.burton
Version: 2.3   
Target Milestone: 2.3 M4   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
one-self test -r wic none

Description Leonardo Sandoval Gonzalez 2017-01-09 17:10:09 UTC 
Some wic checks required certain image type, which is not supported by poky-tiny distro. Currently, these are the failing tests:

---snip---
    2017-01-06 15:24:51 -   test_alternate_output_dir (oeqa.selftest.wic.Wic) ... FAIL (77.935s)
    2017-01-06 15:28:40 -   test_iso_image (oeqa.selftest.wic.Wic) ... FAIL (121.263s)
    2017-01-06 15:31:18 -   test_mkefidisk (oeqa.selftest.wic.Wic) ... FAIL (5.267s)
    2017-01-06 15:31:23 -   test_mkgummidisk (oeqa.selftest.wic.Wic) ... FAIL (5.397s)
    2017-01-06 15:33:21 -   test_systemd_bootdisk (oeqa.selftest.wic.Wic) ... FAIL (5.399s)
---snip---
Comment 1 Leonardo Sandoval Gonzalez 2017-04-04 20:09:19 UTC 
This is the full list:

    14:FAIL: test_bmap_long (oeqa.selftest.wic.Wic)
    321:FAIL: test_bmap_short (oeqa.selftest.wic.Wic)
    525:FAIL: test_bootloader_config (oeqa.selftest.wic.Wic)
    728:FAIL: test_build_artifacts (oeqa.selftest.wic.Wic)
    932:FAIL: test_build_image_name (oeqa.selftest.wic.Wic)
   1136:FAIL: test_build_rootfs_long (oeqa.selftest.wic.Wic)
   1340:FAIL: test_build_rootfs_short (oeqa.selftest.wic.Wic)
   1544:FAIL: test_compress_bzip2 (oeqa.selftest.wic.Wic)
   1748:FAIL: test_compress_gzip (oeqa.selftest.wic.Wic)
   1952:FAIL: test_compress_xz (oeqa.selftest.wic.Wic)
   2155:FAIL: test_createhelp (oeqa.selftest.wic.Wic)
   2358:FAIL: test_debug_long (oeqa.selftest.wic.Wic)
   2562:FAIL: test_debug_short (oeqa.selftest.wic.Wic)
   2766:FAIL: test_default_output_dir (oeqa.selftest.wic.Wic)
   2970:FAIL: test_exclude_path (oeqa.selftest.wic.Wic)
   3174:FAIL: test_exclude_path_errors (oeqa.selftest.wic.Wic)
   3377:FAIL: test_fixed_size (oeqa.selftest.wic.Wic)
   3580:FAIL: test_fixed_size_error (oeqa.selftest.wic.Wic)
   3782:FAIL: test_fs_types (oeqa.selftest.wic.Wic)
   3986:FAIL: test_gpt_image (oeqa.selftest.wic.Wic)
   4189:FAIL: test_help (oeqa.selftest.wic.Wic)
   4393:FAIL: test_help_create (oeqa.selftest.wic.Wic)
   4596:FAIL: test_help_kickstart (oeqa.selftest.wic.Wic)
   4800:FAIL: test_help_list (oeqa.selftest.wic.Wic)
   5004:FAIL: test_help_overview (oeqa.selftest.wic.Wic)
   5208:FAIL: test_help_plugins (oeqa.selftest.wic.Wic)
   5412:FAIL: test_image_bootpart_globbed (oeqa.selftest.wic.Wic)
   5616:FAIL: test_image_env (oeqa.selftest.wic.Wic)
   5820:FAIL: test_image_vars_dir_long (oeqa.selftest.wic.Wic)
   6023:FAIL: test_image_vars_dir_short (oeqa.selftest.wic.Wic)
   6227:FAIL: test_iso_image (oeqa.selftest.wic.Wic)
   6431:FAIL: test_kickstart_parser (oeqa.selftest.wic.Wic)
   6635:FAIL: test_list_images (oeqa.selftest.wic.Wic)
   6839:FAIL: test_list_source_plugins (oeqa.selftest.wic.Wic)
   7043:FAIL: test_listed_images_help (oeqa.selftest.wic.Wic)
   7246:FAIL: test_listhelp (oeqa.selftest.wic.Wic)
   7450:FAIL: test_mkefidisk (oeqa.selftest.wic.Wic)
   7654:FAIL: test_no_command (oeqa.selftest.wic.Wic)
   7858:FAIL: test_qemu (oeqa.selftest.wic.Wic)
   8062:FAIL: test_qemu_efi (oeqa.selftest.wic.Wic)
   8266:FAIL: test_qemux86_directdisk (oeqa.selftest.wic.Wic)
   8469:FAIL: test_rawcopy_plugin (oeqa.selftest.wic.Wic)
   8673:FAIL: test_rawcopy_plugin_qemu (oeqa.selftest.wic.Wic)
   8876:FAIL: test_rootfs_artifacts (oeqa.selftest.wic.Wic)
   9079:FAIL: test_rootfs_indirect_recipes (oeqa.selftest.wic.Wic)
   9283:FAIL: test_sdimage_bootpart (oeqa.selftest.wic.Wic)
   9487:FAIL: test_skip_build_check_long (oeqa.selftest.wic.Wic)
   9690:FAIL: test_skip_build_check_short (oeqa.selftest.wic.Wic)
   9893:FAIL: test_systemd_bootdisk (oeqa.selftest.wic.Wic)
  10096:FAIL: test_unsupported_subcommand (oeqa.selftest.wic.Wic)
  10300:FAIL: test_version (oeqa.selftest.wic.Wic)
  10504:FAIL: test_wic_image_type (oeqa.selftest.wic.Wic)
  10708:FAIL: test_wrong_compressor (oeqa.selftest.wic.Wic)
  10917:FAILED (failures=53)

Failing due to 

    179:| autoreconf: configure.ac: not using Gettext
    305:| checking for xgettext... no
    309:| configure: error: GNU gettext tools not found; required for intltool
Comment 2 Ross Burton 2017-04-04 20:19:21 UTC 
What recipe is that failing?
Comment 3 Leonardo Sandoval Gonzalez 2017-04-05 14:30:03 UTC 
(In reply to comment #2)
> What recipe is that failing?

no recipe, it is the wic test case, executed with 'oe-selftest -r wic'
Comment 4 Leonardo Sandoval Gonzalez 2017-04-05 20:06:47 UTC 
The problem is coming when bitbaking wic-tools, executed at the setUpLocal function, failing on the configure step of one of its dependencies: systemd-boot. Poky-tiny uses sysvinit as distro features so this may be reason of the problem, but I am still identifying the root cause.


| checking for intltool-extract... /home/lsandov1/poky/build/tmp/work/i586-poky-linux-musl/systemd-boot/232-r0/recipe-sysroot-native/usr/bin/intltool-extract
| checking for xgettext... no
| checking for msgmerge... no
| checking for msgfmt... no
| checking for gmsgfmt... no
| configure: error: GNU gettext tools not found; required for intltool
| WARNING: /home/lsandov1/poky/build/tmp/work/i586-poky-linux-musl/systemd-boot/232-r0/temp/run.do_configure.787:1 exit 1 from 'exit 1'
| ERROR: Function failed: do_configure (log file is located at /home/lsandov1/poky/build/tmp/work/i586-poky-linux-musl/systemd-boot/232-r0/temp/log.do_configure.787)
ERROR: Task (/home/lsandov1/poky/meta/recipes-bsp/systemd-boot/systemd-boot_232.bb:do_configure) failed with exit code '1'
NOTE: Tasks Summary: Attempted 609 tasks of which 608 didn't need to be rerun and 1 failed.

Summary: 1 task failed:
  /home/lsandov1/poky/meta/recipes-bsp/systemd-boot/systemd-boot_232.bb:do_configure
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
lsandov1@yctb05:~/poky/build>
Comment 5 Leonardo Sandoval Gonzalez 2017-04-05 22:35:38 UTC 
patch sent and being reviewed at
http://lists.openembedded.org/pipermail/openembedded-core/2017-April/135240.html
Comment 6 Leonardo Sandoval Gonzalez 2017-04-10 17:34:46 UTC 
Patch merged into master: 2830cfec83c9daad8134c3b7227b1ce8b863abc8
Comment 7 oscar lopez arandas 2017-04-17 18:09:49 UTC 
the wic test case, executed with 'one-self test -r wic' work with successfully

testimage: core-image-sato-core2-32.wic
 
Build Configuration:
BB_VERSION        = "1.33.3"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "universal"
TARGET_SYS        = "i686-poky-linux"
MACHINE           = "intel-core2-32"
DISTRO            = "poky"
DISTRO_VERSION    = "2.2+snapshot-20170417"
TUNE_FEATURES     = "m32 core2"
COMMIT: eff56e4f0d59b1d965a68e4f009b7f07717b7edd

    STEPS:
git clone git://git.yoctoproject.org/poky"

b)In poky directory checkout on the desired commit:

$ git checkout <commit-id>

3. Source the environment, from poky directory

 $ cd ~/poky 

$ source oe-init-build-env

4. Edit local.conf. PATH
 5. In ~poky/build directory, in command line, type the following commands:

$ bitbake rpm psplash run-postinsts
$ bitbake package-index

NOTE: After finishing the tasks, copy the image manifest (core-image-sato-sdk-genericx86.manifest) and the testdata.json (core-image-sato-sdk-genericx86.testdata.json) from autobuilder at the following path: "~poky/build/tmp/deploy/images/genericx86/" ( if "/tmp/deploy/images/genericx86" does not exist create new directories with this path)

$ bitbake core-image-sato-sdk -c testimage

$ oe-selftest -r wic

    EXPECTED OUTCOME:
the wic test case, executed with 'one-self test -r wic'fail.
 

    ACTUAL OUTCOME: the wic test case, executed with 'one-self test -r wic' work with successfully

    RESULTS  IN  ATTACHMENT
Comment 8 oscar lopez arandas 2017-04-17 18:10:46 UTC 
Created attachment 3725 [details]
one-self test -r wic
Comment 9 Leonardo Sandoval Gonzalez 2017-04-24 14:42:52 UTC 
(In reply to comment #7)
> the wic test case, executed with 'one-self test -r wic' work with
> successfully
> 
> testimage: core-image-sato-core2-32.wic
>  
> Build Configuration:
> BB_VERSION        = "1.33.3"
> BUILD_SYS         = "x86_64-linux"
> NATIVELSBSTRING   = "universal"
> TARGET_SYS        = "i686-poky-linux"
> MACHINE           = "intel-core2-32"
> DISTRO            = "poky"
> DISTRO_VERSION    = "2.2+snapshot-20170417"
> TUNE_FEATURES     = "m32 core2"
> COMMIT: eff56e4f0d59b1d965a68e4f009b7f07717b7edd
> 
>     STEPS:
> git clone git://git.yoctoproject.org/poky"
> 
> b)In poky directory checkout on the desired commit:
> 
> $ git checkout <commit-id>
> 
> 3. Source the environment, from poky directory
> 
>  $ cd ~/poky 
> 
> $ source oe-init-build-env
> 
> 4. Edit local.conf. PATH

Oscar, which was the included line? I belive you set DISTRO to poky-tiny, which is the only change to be done.


>  5. In ~poky/build directory, in command line, type the following commands:
> 
> $ bitbake rpm psplash run-postinsts
> $ bitbake package-index
> 
> NOTE: After finishing the tasks, copy the image manifest
> (core-image-sato-sdk-genericx86.manifest) and the testdata.json
> (core-image-sato-sdk-genericx86.testdata.json) from autobuilder at the
> following path: "~poky/build/tmp/deploy/images/genericx86/" ( if
> "/tmp/deploy/images/genericx86" does not exist create new directories with
> this path)
> 
> $ bitbake core-image-sato-sdk -c testimage
> 
> $ oe-selftest -r wic
> 
>     EXPECTED OUTCOME:
> the wic test case, executed with 'one-self test -r wic'fail.
>  
> 
>     ACTUAL OUTCOME: the wic test case, executed with 'one-self test -r wic'
> work with successfully
> 
>     RESULTS  IN  ATTACHMENT
Comment 10 oscar lopez arandas 2017-04-24 14:55:24 UTC 
(In reply to comment #9)
> (In reply to comment #7)
> > the wic test case, executed with 'one-self test -r wic' work with
> > successfully
> > 
> > testimage: core-image-sato-core2-32.wic
> >  
> > Build Configuration:
> > BB_VERSION        = "1.33.3"
> > BUILD_SYS         = "x86_64-linux"
> > NATIVELSBSTRING   = "universal"
> > TARGET_SYS        = "i686-poky-linux"
> > MACHINE           = "intel-core2-32"
> > DISTRO            = "poky"
> > DISTRO_VERSION    = "2.2+snapshot-20170417"
> > TUNE_FEATURES     = "m32 core2"
> > COMMIT: eff56e4f0d59b1d965a68e4f009b7f07717b7edd
> > 
> >     STEPS:
> > git clone git://git.yoctoproject.org/poky"
> > 
> > b)In poky directory checkout on the desired commit:
> > 
> > $ git checkout <commit-id>
> > 
> > 3. Source the environment, from poky directory
> > 
> >  $ cd ~/poky 
> > 
> > $ source oe-init-build-env
> > 
> > 4. Edit local.conf. PATH
> 
> Oscar, which was the included line? I belive you set DISTRO to poky-tiny,
> which is the only change to be done.
> Sorry, the line included if it was distro to poky-tiny.
> 
> >  5. In ~poky/build directory, in command line, type the following commands:
> > 
> > $ bitbake rpm psplash run-postinsts
> > $ bitbake package-index
> > 
> > NOTE: After finishing the tasks, copy the image manifest
> > (core-image-sato-sdk-genericx86.manifest) and the testdata.json
> > (core-image-sato-sdk-genericx86.testdata.json) from autobuilder at the
> > following path: "~poky/build/tmp/deploy/images/genericx86/" ( if
> > "/tmp/deploy/images/genericx86" does not exist create new directories with
> > this path)
> > 
> > $ bitbake core-image-sato-sdk -c testimage
> > 
> > $ oe-selftest -r wic
> > 
> >     EXPECTED OUTCOME:
> > the wic test case, executed with 'one-self test -r wic'fail.
> >  
> > 
> >     ACTUAL OUTCOME: the wic test case, executed with 'one-self test -r wic'
> > work with successfully
> > 
> >     RESULTS  IN  ATTACHMENT