10964 2017-01-25 15:06:58 +0000 testimage: Test suite is not running when images are downloaded from Autobuilder 2017-02-08 20:25:09 +0000 1 1 7 Build System, Metadata & Runtime BSPs bsps-oe-core 2.3 x86 Multiple VERIFIED FIXED High normal 2.3 M2 1 jose.perez.carranza mariano.lopez leonardo.sandoval.gonzalez jose.perez.carranza --- --- No (bug/feature does not impact docs) oldest_to_newest 70112 0 jose.perez.carranza 2017-01-25 15:06:58 +0000 Commit: 62d7d4130202d8ede16abf9e7d779361ca70847e AB images: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.3_M2.rc1/machines/ STEPS TO REPRODUCE: 1. Download image to test form AB 2. Prepare the environment according to the image tested $ bitbake rpm psplash $ bitbake package-index 3. $ bitbake core-image-sato-sdk -c testimage EXPECTED RESULT: - Test should be executed correctly ACTUAL RESULT: - Test are not being executed 70134 1 mariano.lopez 2017-01-25 17:16:56 +0000 This happens because there are some hardcoded paths in rpm and smart tests. In order to work around this, it is necessary to modify <image>.tesdata.json. You need to change the WORKDIR and DEPLOY_DIR to fit your current environment (bitbake -e can help you to get your current environment). Also I found two bugs within smart and connman tests. You can find the fixes in the following commits in poky-contrib: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=mariano/bug10964&id=c975cbf858065c4b89fb25e81081b5ecd7abc632 http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=mariano/bug10964&id=acd70b408f334295436908b2a9fa37a66f71cc75 70166 2 jose.perez.carranza 2017-01-25 22:43:37 +0000 With last 3 patches from http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=mariano/bug10964 test are executed correctly but noticed that there were some missing test cases executed for the images tested as follows : core-image-sato-sdk: 201 syslogd workable (auto) 202 syslog configurable (auto) 205 cvs project compile in sdk image (auto) 206 iptables project compile in sdk image (auto) 207 sudoku-savant project compile in sdk image (auto) 1149 test syslog logger (auto) 1150 test syslog restart (auto) 70211 3 mariano.lopez 2017-01-26 21:31:03 +0000 (In reply to comment #2) > With last 3 patches from > http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=mariano/ > bug10964 test are executed correctly but noticed that there were some > missing test cases executed for the images tested as follows : > > core-image-sato-sdk: > > 201 syslogd workable (auto) > 202 syslog configurable (auto) > 205 cvs project compile in sdk image (auto) > 206 iptables project compile in sdk image (auto) > 207 sudoku-savant project compile in sdk image (auto) > 1149 test syslog logger (auto) > 1150 test syslog restart (auto) DEFAULT_TEST_SUITES were missing some tests for core-image-sato-sdk and core-image-lsb-sdk. For syslog it seems the test is not loaded on debian/ubuntu machines. 70235 4 mariano.lopez 2017-01-27 20:20:23 +0000 Sent v2 patches: https://patchwork.openembedded.org/series/4986/ 70258 5 mariano.lopez 2017-01-30 16:18:05 +0000 Sent v3. I hope patchtest won't complain this time. https://patchwork.openembedded.org/series/4986/ 70333 6 mariano.lopez 2017-02-01 15:33:10 +0000 This has been solved in commits: http://git.openembedded.org/openembedded-core/commit/?id=d928e5166d8812e7e20bc95c0a8b5cb5439ec497 http://git.openembedded.org/openembedded-core/commit/?id=570f50b30072a10c5eadfbbfea2647339ee85176 http://git.openembedded.org/openembedded-core/commit/?id=26ad5105fc2ce03b7ee8ecc6911fd40a52bd573a http://git.openembedded.org/openembedded-core/commit/?id=3f1c57191802309e58a7b3b42e8ec812e83bd8ed http://git.openembedded.org/openembedded-core/commit/?id=42f3026b39519ba98ae3153329622ce670d57c09 http://git.openembedded.org/openembedded-core/commit/?id=9923e3cdb58c2b3c54ec5fe99b2cec4cdc9fff92 70557 7 jose.perez.carranza 2017-02-08 20:25:09 +0000 Verified on 2.3 M2 rc3 is working correctly commit: 226a508da955439b881b2f0a544a3aee76e59919