Bug 8288 - oeselftest fails test_image_manifest_entries
Summary: oeselftest fails test_image_manifest_entries
Status: VERIFIED NOTABUG
Alias: None
Product: Runtime Testing
Classification: QA/Testing
Component: general (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium minor
Target Milestone: 2.0
Assignee: Benjamin Esquivel
QA Contact: Bogdan Alexandru Voiculescu
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2015-09-11 12:17 UTC by Beth Flanagan
Modified: 2015-10-28 13:07 UTC (History)
3 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Beth Flanagan 2015-09-11 12:17:02 UTC 
Seen: https://autobuilder.yoctoproject.org/main/builders/nightly-oe-selftest/builds/184/steps/Running%20oe-selftest/logs/stdio

======================================================================
FAIL: test_image_manifest_entries (oeqa.selftest.manifest.VerifyManifest)
Verifying the image manifest entries exist
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/manifest.py", line 165, in test_image_manifest_entries
    if m_collection.errors: self.fail()
AssertionError: None
Comment 1 Benjamin Esquivel 2015-09-11 21:02:33 UTC 
Pasting the log entries that refer to the missing manifest entries:

2015-09-10 04:35:33,456 - selftest.base - DEBUG - VerifyManifest: Check manifest /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/deploy/images/qemux86-64/core-image-minimal-qemux86-64-20150910101305.rootfs.manifest
2015-09-10 04:35:33,459 - selftest.base - DEBUG - VerifyManifest: /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/sysroots/qemux86-64/pkgdata/runtime-reverse/mdadm not found

2015-09-10 04:35:33,464 - selftest.base - DEBUG - VerifyManifest: Check manifest /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/deploy/images/qemux86-64/core-image-directfb-qemux86-64.manifest
2015-09-10 04:35:33,467 - selftest.base - DEBUG - VerifyManifest: /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/sysroots/qemux86-64/pkgdata/runtime-reverse/cronie not found

2015-09-10 04:35:33,573 - selftest.base - DEBUG - VerifyManifest: Check manifest /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/deploy/images/qemux86-64/core-image-directfb-qemux86-64-20150910094633.rootfs.manifest
2015-09-10 04:35:33,575 - selftest.base - DEBUG - VerifyManifest: /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/sysroots/qemux86-64/pkgdata/runtime-reverse/cronie not found
Comment 2 Benjamin Esquivel 2015-09-17 22:53:20 UTC 
I ran a couple of more tests in the GDC autobuilders and I saw the failure again, seems like cronie and mdadm are refusing to join the party, either together or separately.
Comment 3 Benjamin Esquivel 2015-09-18 22:31:10 UTC 
Image manifests in the deploy dir are accumulated, so it keeps the old manifests which are not descriptive of the currently built image.

Need to change the test to target a specific manifest file instead of all the files found in the dir.
Comment 4 Benjamin Esquivel 2015-09-18 22:36:19 UTC 
A pointer to look in the  meta/classes/testimage.bbclass, specifically the following line:

manifest = os.path.join(d.getVar("DEPLOY_DIR_IMAGE", True), d.getVar("IMAGE_LINK_NAME", True) + ".manifest")
Comment 5 Benjamin Esquivel 2015-09-22 22:38:56 UTC 
This is a test error and will be addressed at bug 8028
Comment 6 Bogdan Alexandru Voiculescu 2015-10-28 13:07:58 UTC 
old manifests can have garbage inside until bug 8028 will be merged. 
Not a bug.