6068 2014-03-29 15:43:20 +0000 Create wic test suite 2015-09-15 13:16:25 +0000 1 1 7 Build System, Metadata & Runtime OE-Core deployment 1.9 x86 Multiple VERIFIED FIXED Medium enhancement 1.9 1 tom.zanussi eduard.bartosh alexandru.c.georgescu bluelightning bogdanx.a.voiculescu jessica.zhang daniel.alexandrux.istrate --- --- Don't know oldest_to_newest 41917 0 tom.zanussi 2014-03-29 15:43:20 +0000 wic really needs a (preferably automated) formal testsuite to capture all the usages we expect it to handle, and so we can detect regressions. 41918 1 1866 tom.zanussi 2014-03-29 18:52:13 +0000 Created attachment 1866 .wks example with hardcoded rootfs dir 41919 2 1867 tom.zanussi 2014-03-29 18:53:49 +0000 Created attachment 1867 .wks example with both partitions using indirect strings 41920 3 1868 tom.zanussi 2014-03-29 18:54:14 +0000 Created attachment 1868 .wks example with one partition using indirect strings 41921 4 tom.zanussi 2014-03-29 18:58:26 +0000 As a start, these are the commands tested for the multi-rootfs patches (corresponding .wks files attached): $ wic create directdisk -e core-image-minimal $ wic create directdisk -b /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/share -k /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/src/kernel -n /home/trz/yocto/master-cur/build/tmp/sysroots/x86_64-linux -r /home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ $ wic create directdisk-multi -e core-image-minimal $ wic create directdisk-multi -b /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/share -k /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/src/kernel -n /home/trz/yocto/master-cur/build/tmp/sysroots/x86_64-linux -r /home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ $ wic create directdisk-multi-indirect-both --rootfs-dir rootfs1=/home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ --rootfs-dir rootfs2=/home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ -e core-image-minimal $ wic create directdisk-multi-indirect-both -b /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/share -k /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/src/kernel -n /home/trz/yocto/master-cur/build/tmp/sysroots/x86_64-linux --rootfs-dir rootfs1=/home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ --rootfs-dir rootfs2=/home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ $ wic create directdisk-multi-indirect-second -r /home/trz/yocto/master-cur/buil/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ --rootfs-dir rootfs2=/home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ -e core-image-minimal $ wic create directdisk-multi-indirect-second -b /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/share -k /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay/usr/src/kernel -n /home/trz/yocto/master-cur/build/tmp/sysroots/x86_64-linux -r /home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ --rootfs-dir rootfs2=/home/trz/yocto/master-cur/build/tmp/work/crownbay-poky-linux/core-image-minimal/1.0-r0/rootfs/ 43183 5 tom.zanussi 2014-05-08 14:49:24 +0000 And a couple more for the image rootfs option: wic create directdisk-multi-indirect-both --rootfs-dir rootfs1=core-image-minimal --rootfs-dir rootfs2=core-image-minimal -e core-image-minimal wic create directdisk-multi-indirect-both -b /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay-noemgd/usr/share -k /home/trz/yocto/master-cur/build/tmp/sysroots/crownbay-noemgd/usr/src/kernel -n /home/trz/yocto/master-cur/build/tmp/sysroots/x86_64-linux --rootfs-dir rootfs1=/home/trz/yocto/master-cur/build/tmp/work/crownbay_noemgd-poky-linux/core-image-minimal/1.0-r0/rootfs/ --rootfs-dir rootfs2=core-image-minimal 50612 6 eduard.bartosh 2015-04-29 15:21:36 +0000 Start working with QA team to add wic test cases to oe-selftest 51962 7 eduard.bartosh 2015-06-26 13:15:08 +0000 Status update. 16 test cases have been created and put into production on AB. Here is how wic testing looks atm: $ oe-selftest --run-tests wic 2015-06-26 16:06:06,272 - selftest - INFO - Checking that everything is in order before running the tests 2015-06-26 16:06:07,172 - selftest - INFO - Running bitbake -p 2015-06-26 16:06:09,719 - selftest - INFO - Loading tests from: oeqa.selftest.wic 2015-06-26 16:06:09,721 - selftest - INFO - Adding: "include selftest.inc" in local.conf test01_help (oeqa.selftest.wic.Wic) Test wic --help ... ok test02_createhelp (oeqa.selftest.wic.Wic) Test wic create --help ... ok test03_listhelp (oeqa.selftest.wic.Wic) Test wic list --help ... ok test04_build_image_name (oeqa.selftest.wic.Wic) Test wic create directdisk --image-name core-image-minimal ... ok test05_build_artifacts (oeqa.selftest.wic.Wic) Test wic create directdisk providing all artifacts. ... ok test06_gpt_image (oeqa.selftest.wic.Wic) Test creation of core-image-minimal with gpt table and UUID boot ... ok test07_unsupported_subcommand (oeqa.selftest.wic.Wic) Test unsupported subcommand ... ok test08_no_command (oeqa.selftest.wic.Wic) Test wic without command ... ok test09_help_kickstart (oeqa.selftest.wic.Wic) Test wic help overview ... ok test10_help_plugins (oeqa.selftest.wic.Wic) Test wic help plugins ... ok test11_help_kickstart (oeqa.selftest.wic.Wic) Test wic help kickstart ... ok test12_compress_gzip (oeqa.selftest.wic.Wic) Test compressing an image with gzip ... ok test13_compress_gzip (oeqa.selftest.wic.Wic) Test compressing an image with bzip2 ... ok test14_compress_gzip (oeqa.selftest.wic.Wic) Test compressing an image with xz ... ok test15_wrong_compressor (oeqa.selftest.wic.Wic) Test how wic breaks if wrong compressor is provided ... ok test16_rootfs_indirect_recipes (oeqa.selftest.wic.Wic) Test usage of rootfs plugin with 'rootfsN=<recipe>' syntax ... ok ---------------------------------------------------------------------- Ran 16 tests in 90.257s OK 2015-06-26 16:07:39,979 - selftest - INFO - Finished 2015-06-26 16:07:39,979 - selftest - INFO - Removing the include from local.conf I'm going to close this bug and I'll continue to add new test cases for new and old functionality. 51985 8 eduard.bartosh 2015-06-29 08:24:48 +0000 15 test cases are in master now: http://cgit.openembedded.org/openembedded-core/commit/?id=0ffc5c38ef28605abf815a47eb41923802d31df7 2 more are waiting for review. I think it's enough to say that wic testing suite is created and put into production. 54079 9 daniel.alexandrux.istrate 2015-09-15 13:16:25 +0000 As of now in master: ea562de57590c966cd5a75fda8defecd397e6436 there are 23 test cases in meta/lib/oeqa/selftest/wic.py 1866 2014-03-29 18:52:13 +0000 2014-03-29 18:52:13 +0000 .wks example with hardcoded rootfs dir directdisk-multi.wks application/vnd.lotus-1-2-3 646 tom.zanussi IyBzaG9ydC1kZXNjcmlwdGlvbjogQ3JlYXRlIGEgJ3BjYmlvcycgZGlyZWN0IGRpc2sgaW1hZ2UK IyBsb25nLWRlc2NyaXB0aW9uOiBDcmVhdGVzIGEgcGFydGl0aW9uZWQgbGVnYWN5IEJJT1MgZGlz ayBpbWFnZSB0aGF0IHRoZSB1c2VyCiMgY2FuIGRpcmVjdGx5IGRkIHRvIGJvb3QgbWVkaWEuCgoK cGFydCAvYm9vdCAtLXNvdXJjZSBib290aW1nLXBjYmlvcyAtLW9uZGlzayBzZGEgLS1mc3R5cGU9 bXNkb3MgLS1sYWJlbCBib290IC0tYWN0aXZlIC0tYWxpZ24gMTAyNApwYXJ0IC8gLS1zb3VyY2Ug cm9vdGZzIC0tb25kaXNrIHNkYSAtLWZzdHlwZT1leHQzIC0tbGFiZWwgcGxhdGZvcm0gLS1hbGln biAxMDI0CgpwYXJ0IC9zdGFuZGJ5IC0tc291cmNlIHJvb3RmcyAtLXJvb3Rmcy1kaXI9L2hvbWUv dHJ6L3lvY3RvL21hc3Rlci1jdXIvYnVpbGQvdG1wL3dvcmsvY3Jvd25iYXktcG9reS1saW51eC9j b3JlLWltYWdlLW1pbmltYWwvMS4wLXIwL3Jvb3Rmcy8gLS1vbmRpc2sgc2RhIC0tZnN0eXBlPWV4 dDMgLS1sYWJlbCBzZWNvbmRhcnkgLS1hbGlnbiAxMDI0Cgpib290bG9hZGVyICAtLXRpbWVvdXQ9 MCAgLS1hcHBlbmQ9InJvb3R3YWl0IHJvb3Rmc3R5cGU9ZXh0MyB2aWRlbz12ZXNhZmIgdmdhPTB4 MzE4IGNvbnNvbGU9dHR5MCIKCg== 1867 2014-03-29 18:53:49 +0000 2014-03-29 18:53:49 +0000 .wks example with both partitions using indirect strings directdisk-multi-indirect-both.wks application/vnd.lotus-1-2-3 583 tom.zanussi IyBzaG9ydC1kZXNjcmlwdGlvbjogQ3JlYXRlIGEgJ3BjYmlvcycgZGlyZWN0IGRpc2sgaW1hZ2UK IyBsb25nLWRlc2NyaXB0aW9uOiBDcmVhdGVzIGEgcGFydGl0aW9uZWQgbGVnYWN5IEJJT1MgZGlz ayBpbWFnZSB0aGF0IHRoZSB1c2VyCiMgY2FuIGRpcmVjdGx5IGRkIHRvIGJvb3QgbWVkaWEuCgoK cGFydCAvYm9vdCAtLXNvdXJjZSBib290aW1nLXBjYmlvcyAtLW9uZGlzayBzZGEgLS1mc3R5cGU9 bXNkb3MgLS1sYWJlbCBib290IC0tYWN0aXZlIC0tYWxpZ24gMTAyNApwYXJ0IC8gLS1zb3VyY2Ug cm9vdGZzIC0tcm9vdGZzLWRpcj0icm9vdGZzMSIgLS1vbmRpc2sgc2RhIC0tZnN0eXBlPWV4dDMg LS1sYWJlbCBwbGF0Zm9ybSAtLWFsaWduIDEwMjQKCnBhcnQgL3N0YW5kYnkgLS1zb3VyY2Ugcm9v dGZzIC0tcm9vdGZzLWRpcj0icm9vdGZzMiIgLS1vbmRpc2sgc2RhIC0tZnN0eXBlPWV4dDMgLS1s YWJlbCBzZWNvbmRhcnkgLS1hbGlnbiAxMDI0Cgpib290bG9hZGVyICAtLXRpbWVvdXQ9MCAgLS1h cHBlbmQ9InJvb3R3YWl0IHJvb3Rmc3R5cGU9ZXh0MyB2aWRlbz12ZXNhZmIgdmdhPTB4MzE4IGNv bnNvbGU9dHR5MCIKCg== 1868 2014-03-29 18:54:14 +0000 2014-03-29 18:54:14 +0000 .wks example with one partition using indirect strings directdisk-multi-indirect-second.wks application/vnd.lotus-1-2-3 559 tom.zanussi IyBzaG9ydC1kZXNjcmlwdGlvbjogQ3JlYXRlIGEgJ3BjYmlvcycgZGlyZWN0IGRpc2sgaW1hZ2UK IyBsb25nLWRlc2NyaXB0aW9uOiBDcmVhdGVzIGEgcGFydGl0aW9uZWQgbGVnYWN5IEJJT1MgZGlz ayBpbWFnZSB0aGF0IHRoZSB1c2VyCiMgY2FuIGRpcmVjdGx5IGRkIHRvIGJvb3QgbWVkaWEuCgpw YXJ0IC9ib290IC0tc291cmNlIGJvb3RpbWctcGNiaW9zIC0tb25kaXNrIHNkYSAtLWZzdHlwZT1t c2RvcyAtLWxhYmVsIGJvb3QgLS1hY3RpdmUgLS1hbGlnbiAxMDI0CnBhcnQgLyAtLXNvdXJjZSBy b290ZnMgLS1vbmRpc2sgc2RhIC0tZnN0eXBlPWV4dDMgLS1sYWJlbCBwbGF0Zm9ybSAtLWFsaWdu IDEwMjQKCnBhcnQgL3N0YW5kYnkgLS1zb3VyY2Ugcm9vdGZzIC0tcm9vdGZzLWRpcj0icm9vdGZz MiIgLS1vbmRpc2sgc2RhIC0tZnN0eXBlPWV4dDMgLS1sYWJlbCBzZWNvbmRhcnkgLS1hbGlnbiAx MDI0Cgpib290bG9hZGVyICAtLXRpbWVvdXQ9MCAgLS1hcHBlbmQ9InJvb3R3YWl0IHJvb3Rmc3R5 cGU9ZXh0MyB2aWRlbz12ZXNhZmIgdmdhPTB4MzE4IGNvbnNvbGU9dHR5MCIKCg==