Bug 11565

Summary: morty self-test errors
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Juro Bystricky <juro.bystricky>
Component: coreAssignee: Ross Burton <ross.burton>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: akuster, meta.mr.watcher, meta.watcher, richard.purdie
Version: 2.2.2   
Target Milestone: 2.2.2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
console output none

Description Juro Bystricky 2017-05-22 20:20:28 UTC 
Created attachment 3775 [details]
console output

Various errors reported by AB:
https://autobuilder.yocto.io/builders/nightly-oe-selftest/builds/299

======================================================================
ERROR [22.523s]: test_continue (oeqa.selftest.bbtests.BitbakeTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/bbtests.py", line 227, in test_continue
    continuepos = result.output.find('NOTE: recipe xcursor-transparent-theme-%s: task do_unpack: Started' % manver.group(1))
AttributeError: 'NoneType' object has no attribute 'group'

======================================================================
ERROR [27.392s]: test_force_task_1 (oeqa.selftest.bbtests.BitbakeTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/bbtests.py", line 91, in test_force_task_1
    ftools.append_file(man_file, test_data)
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/ftools.py", line 18, in append_file
    with open(path, "a") as f:
FileNotFoundError: [Errno 2] No such file or directory: '/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/work/core2-64-poky-linux/zlib/1.2.8-r0/image/usr/share/man/man3/zlib.3'

======================================================================
ERROR [0.000s]: setUpClass (oeqa.selftest.signing.Signing)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/signing.py", line 30, in setUpClass
    runCmd('gpg --homedir %s --import %s %s' % (cls.gpg_dir, cls.pub_key_path, cls.secret_key_path))
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/commands.py", line 114, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, result.output))
AssertionError: Command 'gpg --homedir /tmp/oeqa-signing-4uec25ej --import /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta-selftest/files/signing/key.pub /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta-selftest/files/signing/key.secret' returned non-zero exit status 2:
gpg: keybox '/tmp/oeqa-signing-4uec25ej/pubring.kbx' created
gpg: /tmp/oeqa-signing-4uec25ej/trustdb.gpg: trustdb created
gpg: key 7B31316B5D64AD52: public key "testuser (nocomment) <testuser@testemail.com>" imported
gpg: key 7B31316B5D64AD52: "testuser (nocomment) <testuser@testemail.com>" not changed
gpg: key 7B31316B5D64AD52/7B31316B5D64AD52: error sending to agent: Inappropriate ioctl for device
gpg: error building skey array: Inappropriate ioctl for device
gpg: Total number processed: 2
gpg:               imported: 1
gpg:              unchanged: 1
gpg:       secret keys read: 1
2017-05-22 09:46:44,736 - selftest - INFO - Finished
2017-05-22 09:46:44,736 - selftest - INFO - Removing the include from local.conf
2017-05-22 09:46:44,737 - selftest - INFO - Removing the include from bblayers.conf

======================================================================
FAIL [15.794s]: test_sanity_unsafe_binary_references (oeqa.selftest.buildoptions.SanityOptionsTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/buildoptions.py", line 130, in test_sanity_unsafe_binary_references
    self.assertTrue(line and line.startswith("WARNING:"), "WARNING: QA Issue: nfs-utils message is not present in bitbake's output: %s" % res.output)
AssertionError: None is not true : WARNING: QA Issue: nfs-utils message is not present in bitbake's output: Loading cache...done.
Loaded 1328 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies
Comment 1 Ross Burton 2017-05-24 17:01:43 UTC 
test_continue in morty is wasteful, I've cherry-picked a patch from pyro to make it a lot faster/reliable.

test_sanity_unsafe_binary_references is known to be broken by design, I've cherry-picked two patches from pyro to just delete it.
Comment 2 Ross Burton 2017-05-25 11:15:30 UTC 
I re-ran selftest with the broken tests removed and it passed.  I think the signing setup and force task failures were transient as it executed on the debian-testing machine which has seen odd problems in the past.
Comment 3 Richard Purdie 2017-06-05 14:36:04 UTC 
There were various fixes backported to morty to address these: http://git.yoctoproject.org/cgit.cgi/poky/commit/?h=morty&id=c2ade72828822410644530966a8c526f52b1af9b