Created attachment 3775 [details] console output Various errors reported by AB: https://autobuilder.yocto.io/builders/nightly-oe-selftest/builds/299 ====================================================================== ERROR [22.523s]: test_continue (oeqa.selftest.bbtests.BitbakeTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/bbtests.py", line 227, in test_continue continuepos = result.output.find('NOTE: recipe xcursor-transparent-theme-%s: task do_unpack: Started' % manver.group(1)) AttributeError: 'NoneType' object has no attribute 'group' ====================================================================== ERROR [27.392s]: test_force_task_1 (oeqa.selftest.bbtests.BitbakeTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/bbtests.py", line 91, in test_force_task_1 ftools.append_file(man_file, test_data) File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/ftools.py", line 18, in append_file with open(path, "a") as f: FileNotFoundError: [Errno 2] No such file or directory: '/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/work/core2-64-poky-linux/zlib/1.2.8-r0/image/usr/share/man/man3/zlib.3' ====================================================================== ERROR [0.000s]: setUpClass (oeqa.selftest.signing.Signing) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/signing.py", line 30, in setUpClass runCmd('gpg --homedir %s --import %s %s' % (cls.gpg_dir, cls.pub_key_path, cls.secret_key_path)) File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/commands.py", line 114, in runCmd raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, result.output)) AssertionError: Command 'gpg --homedir /tmp/oeqa-signing-4uec25ej --import /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta-selftest/files/signing/key.pub /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta-selftest/files/signing/key.secret' returned non-zero exit status 2: gpg: keybox '/tmp/oeqa-signing-4uec25ej/pubring.kbx' created gpg: /tmp/oeqa-signing-4uec25ej/trustdb.gpg: trustdb created gpg: key 7B31316B5D64AD52: public key "testuser (nocomment) <testuser@testemail.com>" imported gpg: key 7B31316B5D64AD52: "testuser (nocomment) <testuser@testemail.com>" not changed gpg: key 7B31316B5D64AD52/7B31316B5D64AD52: error sending to agent: Inappropriate ioctl for device gpg: error building skey array: Inappropriate ioctl for device gpg: Total number processed: 2 gpg: imported: 1 gpg: unchanged: 1 gpg: secret keys read: 1 2017-05-22 09:46:44,736 - selftest - INFO - Finished 2017-05-22 09:46:44,736 - selftest - INFO - Removing the include from local.conf 2017-05-22 09:46:44,737 - selftest - INFO - Removing the include from bblayers.conf ====================================================================== FAIL [15.794s]: test_sanity_unsafe_binary_references (oeqa.selftest.buildoptions.SanityOptionsTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/buildoptions.py", line 130, in test_sanity_unsafe_binary_references self.assertTrue(line and line.startswith("WARNING:"), "WARNING: QA Issue: nfs-utils message is not present in bitbake's output: %s" % res.output) AssertionError: None is not true : WARNING: QA Issue: nfs-utils message is not present in bitbake's output: Loading cache...done. Loaded 1328 entries from dependency cache. NOTE: Resolving any missing task queue dependencies
test_continue in morty is wasteful, I've cherry-picked a patch from pyro to make it a lot faster/reliable. test_sanity_unsafe_binary_references is known to be broken by design, I've cherry-picked two patches from pyro to just delete it.
I re-ran selftest with the broken tests removed and it passed. I think the signing setup and force task failures were transient as it executed on the debian-testing machine which has seen odd problems in the past.
There were various fixes backported to morty to address these: http://git.yoctoproject.org/cgit.cgi/poky/commit/?h=morty&id=c2ade72828822410644530966a8c526f52b1af9b