Bug 6926 - Create yocto-bsp testsuite/testplan
Summary: Create yocto-bsp testsuite/testplan
Status: RESOLVED OBSOLETE
Alias: None
Product: Meta-yocto
Classification: Build System, Metadata & Runtime
Component: meta-yocto (show other bugs)
Version: 1.8
Hardware: All Multiple
: Medium enhancement
Target Milestone: 2.5
Assignee: yeoh ee peng
QA Contact:
URL:
Whiteboard:
Depends on: 11805 11806
Blocks:
  Show dependency tree
 
Reported: 2014-11-03 22:34 UTC by Tom Zanussi
Modified: 2017-12-04 20:08 UTC (History)
7 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: Don't know


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Tom Zanussi 2014-11-03 22:34:50 UTC
We need to have a test suite that can be run on command in an automated fashion to test every reasonable permutation of functionality available via the yocto-bsp/yocto-kernel tools.

Overall, this would mean having the testsuite create, compile, and preferably boot-test each combination of architecture/kernel version/kernel type/branch type, along with important machine options.

Additionally, the tool would automate testing of creating/adding/removing kernel configuration and patches using the yocto-kernel tool.

This should be relatively straightforward for at least the qemu machines, since we already have test harnesses for build/run-time testing of those; boot-testing on real hardware will be more of a challenge.
Comment 1 Alexandru Georgescu 2015-10-13 07:35:22 UTC
Hi Markus,
What's this status of this enhancement? Is there a need for additional testing from QA?
Comment 2 Markus Lehtonen 2015-10-13 09:12:16 UTC
Targeted for 2.1
Comment 3 Leonardo Sandoval Gonzalez 2016-10-10 14:36:39 UTC
From Yi Zhao, commenting about current tests (not automated)

"Currently we have several test cases  against the reference: https://wiki.yoctoproject.org/wiki/Transcript:_Using_the_Yocto_BSP_tools_to_create_a_qemu_BSP

These cases are in the testopia: https://bugzilla.yoctoproject.org/tr_show_plan.cgi?plan_id=26

case id: 303 - 313

"

These are also the suggested tests cases for oeqa:


1. build core-image-minimal images for qemu i386 and x86_64 architectures and boot them using runqemu

    The expected result is an bootable image

2. build kernels for all architectures, all with default options

   The expected result is buildable virtual/kernel
Comment 4 Leonardo Sandoval Gonzalez 2016-10-10 19:54:41 UTC
To be worked during 2.3 M2
Comment 5 Humberto Ibarra 2017-01-25 20:17:34 UTC
Moving target to M3
Comment 6 Jose Perez C 2017-08-30 15:52:25 UTC
Moved to 2.5 due resources constraint
Comment 7 Leonardo Sandoval Gonzalez 2017-12-04 15:01:47 UTC
The tool yocto-bsp has been removed from main branch (the reason is basically lack of maintenance and no more improvements done since conception), so in my opinion this can be resolved as obsoleted.
Comment 8 Paul Eggleton 2017-12-04 20:08:20 UTC
Indeed, marking obsolete - thanks Leo.