Bug 10768 - Tests for Build Appliance need to be translated to run on the poky container
Summary: Tests for Build Appliance need to be translated to run on the poky container
Status: RESOLVED FIXED
Alias: None
Product: Testopia
Classification: Infrastructure
Component: testopia (show other bugs)
Version: 2.3
Hardware: x86 Multiple
: High normal
Target Milestone: 2.3 M2
Assignee: brian avery
QA Contact: Yi Zhao
URL:
Whiteboard:
Depends on:
Blocks: 9592 10769
  Show dependency tree
 
Reported: 2016-12-05 18:32 UTC by brian avery
Modified: 2017-04-11 16:17 UTC (History)
3 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description brian avery 2016-12-05 18:32:13 UTC
and/or the toaster container.  In order to move forward with replacing the Build Appliance with the set of containers, we need to make sure that whatever tests we are currently running on the Build Appliance pass on the containers.  This is intended to create functionally equivalent tests.
Comment 1 Yi Zhao 2016-12-09 02:44:32 UTC
(In reply to comment #0)
> and/or the toaster container.  In order to move forward with replacing the
> Build Appliance with the set of containers, we need to make sure that
> whatever tests we are currently running on the Build Appliance pass on the
> containers.  This is intended to create functionally equivalent tests.

Hi Brian,

You could find the current BA test cases in: https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=6552
Comment 2 Yi Zhao 2017-01-11 00:07:44 UTC
The current test cases for BA: https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=6552
Comment 3 brian avery 2017-01-12 19:06:20 UTC
We have 4 test cases for the Build Appliance:
322 - Build the BA itself.

340 - Boot the BA with Vmplayer, build core-image-minimal, launch image with hob.

565 - Use Hob to build an image then add acpid to the image.

938 - Use Hob to see the build log.

-----
Comments wrt the Build Appliance:
1) Hob is no longer in the src tree, so it can't be used.
2) Toaster can be used to do the Hob operations tested above except for launching the image which can be easily done using runqemu. Alternatively these operations can be tested using the cli alone.
 
----
Comments wrt the containers:

322 - will require having docker installed on the autobuilder slaves, then it's a one line command.
340 - using the poky container crops/poky this can be done with the cli
565 - using the poky container crops/poky this can be done with the cli; using the toaster container crops/toaster it can be done with Toaster.  Launching the image needs to be done from the cli and we are still knocking off bugs about qemu and vnc to make this possible.
938 - using the poky container crops/poky this can be done with the cli; using the toaster container crops/toaster it can be done with Toaster.

----
General comment: 
Currently I expect to replace the Build Appliance with a family of containers rather than one big one:
1) poky for general bitbake cli work
2) toaster for toaster centric people, though it can also be used in a cli fashion
3) esdk container for esdk/devtool folks
----
If this is enough info, please switch the status, otherwise ask for clarification :)
Comment 4 brian avery 2017-01-12 21:07:10 UTC
per Stephen suggestion. Moving back to accepted.
Comment 5 Yi Zhao 2017-01-18 03:31:04 UTC
(In reply to comment #3)
> We have 4 test cases for the Build Appliance:
> 322 - Build the BA itself.
> 
> 340 - Boot the BA with Vmplayer, build core-image-minimal, launch image with
> hob.
> 
> 565 - Use Hob to build an image then add acpid to the image.
> 
> 938 - Use Hob to see the build log.
> 
> -----
> Comments wrt the Build Appliance:
> 1) Hob is no longer in the src tree, so it can't be used.
> 2) Toaster can be used to do the Hob operations tested above except for
> launching the image which can be easily done using runqemu. Alternatively
> these operations can be tested using the cli alone.

Hi Brian,

After HOB disappeared, we don't use toaster but only use command line "bitbake core-image-minimal" to build the image and runqemu to launch the image in BA.

>  
> ----
> Comments wrt the containers:
> 
> 322 - will require having docker installed on the autobuilder slaves, then
> it's a one line command.
> 340 - using the poky container crops/poky this can be done with the cli
> 565 - using the poky container crops/poky this can be done with the cli;
> using the toaster container crops/toaster it can be done with Toaster. 
> Launching the image needs to be done from the cli and we are still knocking
> off bugs about qemu and vnc to make this possible.
> 938 - using the poky container crops/poky this can be done with the cli;
> using the toaster container crops/toaster it can be done with Toaster.
> 
> ----
> General comment: 
> Currently I expect to replace the Build Appliance with a family of
> containers rather than one big one:
> 1) poky for general bitbake cli work
> 2) toaster for toaster centric people, though it can also be used in a cli
> fashion
> 3) esdk container for esdk/devtool folks
> ----
> If this is enough info, please switch the status, otherwise ask for
> clarification :)

That's fine to me.

Thanks,
Yi
Comment 6 Yi Zhao 2017-01-19 00:33:33 UTC
Hi Brian,

I think  you could close this bug.
Comment 7 brian avery 2017-01-19 15:59:37 UTC
per comment 6