Bug 6926

Summary:	Create yocto-bsp testsuite/testplan
Product:	[Build System, Metadata & Runtime] Meta-yocto	Reporter:	Tom Zanussi <tom.zanussi>
Component:	meta-yocto	Assignee:	yeoh ee peng <ee.peng.yeoh>
Status:	RESOLVED OBSOLETE	QA Contact:
Severity:	enhancement
Priority:	Medium	CC:	alexandru.c.georgescu, bluelightning, humberto.ibarra.lopez, leonardo.sandoval.gonzalez, poky.bs.watcher, poky.watcher, sgw
Version:	1.8
Target Milestone:	2.5
Hardware:	All
OS:	Multiple
Whiteboard:
OS type for building Yocto:	---	Type of Regression:	---
Verified:		Documentation change:	Don't know
Bug Depends on:	11805, 11806
Bug Blocks:

Description Tom Zanussi 2014-11-03 22:34:50 UTC

We need to have a test suite that can be run on command in an automated fashion to test every reasonable permutation of functionality available via the yocto-bsp/yocto-kernel tools.

Overall, this would mean having the testsuite create, compile, and preferably boot-test each combination of architecture/kernel version/kernel type/branch type, along with important machine options.

Additionally, the tool would automate testing of creating/adding/removing kernel configuration and patches using the yocto-kernel tool.

This should be relatively straightforward for at least the qemu machines, since we already have test harnesses for build/run-time testing of those; boot-testing on real hardware will be more of a challenge.

Comment 1 Alexandru Georgescu 2015-10-13 07:35:22 UTC

Hi Markus,
What's this status of this enhancement? Is there a need for additional testing from QA?

Comment 2 Markus Lehtonen 2015-10-13 09:12:16 UTC

Targeted for 2.1

Comment 3 Leonardo Sandoval Gonzalez 2016-10-10 14:36:39 UTC

From Yi Zhao, commenting about current tests (not automated)

"Currently we have several test cases  against the reference: https://wiki.yoctoproject.org/wiki/Transcript:_Using_the_Yocto_BSP_tools_to_create_a_qemu_BSP

These cases are in the testopia: https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=26

case id: 303 - 313

"

These are also the suggested tests cases for oeqa:


1. build core-image-minimal images for qemu i386 and x86_64 architectures and boot them using runqemu

    The expected result is an bootable image

2. build kernels for all architectures, all with default options

   The expected result is buildable virtual/kernel

Comment 4 Leonardo Sandoval Gonzalez 2016-10-10 19:54:41 UTC

To be worked during 2.3 M2

Comment 5 Humberto Ibarra 2017-01-25 20:17:34 UTC

Moving target to M3

Comment 6 Jose Perez C 2017-08-30 15:52:25 UTC

Moved to 2.5 due resources constraint

Comment 7 Leonardo Sandoval Gonzalez 2017-12-04 15:01:47 UTC

The tool yocto-bsp has been removed from main branch (the reason is basically lack of maintenance and no more improvements done since conception), so in my opinion this can be resolved as obsoleted.

Comment 8 Paul Eggleton 2017-12-04 20:08:20 UTC

Indeed, marking obsolete - thanks Leo.