Bug 8288

Summary:	oeselftest fails test_image_manifest_entries
Product:	[QA/Testing] Runtime Testing	Reporter:	Beth Flanagan <elizabeth.flanagan>
Component:	general	Assignee:	Benjamin Esquivel <benjamin.esquivel>
Status:	VERIFIED NOTABUG	QA Contact:	Bogdan Alexandru Voiculescu <bogdanx.a.voiculescu>
Severity:	minor
Priority:	Medium	CC:	benjamin.esquivel, bogdanx.a.voiculescu, mariano.lopez
Version:	unspecified
Target Milestone:	2.0
Hardware:	x86
OS:	Multiple
Whiteboard:
OS type for building Yocto:	---	Type of Regression:	---
Verified:		Documentation change:	No (bug/feature does not impact docs)

Description Beth Flanagan 2015-09-11 12:17:02 UTC

Seen: https://autobuilder.yoctoproject.org/main/builders/nightly-oe-selftest/builds/184/steps/Running%20oe-selftest/logs/stdio

======================================================================
FAIL: test_image_manifest_entries (oeqa.selftest.manifest.VerifyManifest)
Verifying the image manifest entries exist
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/manifest.py", line 165, in test_image_manifest_entries
    if m_collection.errors: self.fail()
AssertionError: None

Comment 1 Benjamin Esquivel 2015-09-11 21:02:33 UTC

Pasting the log entries that refer to the missing manifest entries:

2015-09-10 04:35:33,456 - selftest.base - DEBUG - VerifyManifest: Check manifest /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/deploy/images/qemux86-64/core-image-minimal-qemux86-64-20150910101305.rootfs.manifest
2015-09-10 04:35:33,459 - selftest.base - DEBUG - VerifyManifest: /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/sysroots/qemux86-64/pkgdata/runtime-reverse/mdadm not found

2015-09-10 04:35:33,464 - selftest.base - DEBUG - VerifyManifest: Check manifest /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/deploy/images/qemux86-64/core-image-directfb-qemux86-64.manifest
2015-09-10 04:35:33,467 - selftest.base - DEBUG - VerifyManifest: /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/sysroots/qemux86-64/pkgdata/runtime-reverse/cronie not found

2015-09-10 04:35:33,573 - selftest.base - DEBUG - VerifyManifest: Check manifest /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/deploy/images/qemux86-64/core-image-directfb-qemux86-64-20150910094633.rootfs.manifest
2015-09-10 04:35:33,575 - selftest.base - DEBUG - VerifyManifest: /home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/build/tmp/sysroots/qemux86-64/pkgdata/runtime-reverse/cronie not found

Comment 2 Benjamin Esquivel 2015-09-17 22:53:20 UTC

I ran a couple of more tests in the GDC autobuilders and I saw the failure again, seems like cronie and mdadm are refusing to join the party, either together or separately.

Comment 3 Benjamin Esquivel 2015-09-18 22:31:10 UTC

Image manifests in the deploy dir are accumulated, so it keeps the old manifests which are not descriptive of the currently built image.

Need to change the test to target a specific manifest file instead of all the files found in the dir.

Comment 4 Benjamin Esquivel 2015-09-18 22:36:19 UTC

A pointer to look in the  meta/classes/testimage.bbclass, specifically the following line:

manifest = os.path.join(d.getVar("DEPLOY_DIR_IMAGE", True), d.getVar("IMAGE_LINK_NAME", True) + ".manifest")

Comment 5 Benjamin Esquivel 2015-09-22 22:38:56 UTC

This is a test error and will be addressed at bug 8028

Comment 6 Bogdan Alexandru Voiculescu 2015-10-28 13:07:58 UTC

old manifests can have garbage inside until bug 8028 will be merged. 
Not a bug.