5554 2013-11-18 16:55:22 +0000 Add abstraction for running tests on real hardware 2014-08-19 11:40:58 +0000 1 1 10 QA/Testing Runtime Testing general 1.6 All Multiple VERIFIED FIXED 18 April 2014: Setting documentation flag to "Done". Medium+ enhancement 1.6 M1 1596 1 bluelightning sstncr bluelightning bogdanx.a.voiculescu jessica.zhang srifenbark bogdanx.a.voiculescu --- --- Done (doc changes complete) oldest_to_newest 38879 0 bluelightning 2013-11-18 16:55:22 +0000 Insert some abstraction between the request to run a test and the launching of it in QEMU so that we can also run the test on real hardware. How the test should be run should be able to be set via a variable, and the variable's value should map to a python class with the implementation of how the image should be deployed and booted. We should create two initial implementations: 1) A QEMU implementation (does what it does currently) 2) A very simple remote implementation which does not deploy the image but runs the tests on a remote machine via ssh to a specified IP address. In the current code there's a fair amount of isolation here already so this shouldn't be too tricky. 39080 1 sstncr 2013-11-25 17:56:02 +0000 Patches on the ML. 39219 2 sstncr 2013-12-04 08:08:36 +0000 http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=b4d9b4208b1c06164c4eeea2110408fb404dba1c http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=17e3dc2cb5e7c060647a29a508d43a622ba53b80 42405 3 srifenbark 2014-04-08 20:31:10 +0000 Hi, I have added several areas to address this documentation part of the bug based on Stefan's email he sent me. The new sections need a good review. I had some difficulty unwrapping the raw information into individual sections so please look it over and comment: http://www.yoctoproject.org/docs/1.6/dev-manual/dev-manual.html#performing-automated-runtime-testing - This is the main section on running tests in the dev-manual. It now needs to cover qemu and actual hardware. I suspect we need to work on this section some more. These next links are to the new variables. http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#var-TEST_TARGET http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_TARGET_IP http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_SERVER_IP http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_LOG_DIR http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_EXPORT_ONLY http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_EXPORT_DIR 42573 4 srifenbark 2014-04-10 19:12:38 +0000 Hi, I realized that this area in the manual also needed adjusting based on the ability to now run tests on hardware - http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#ref-classes-testimage. I basically removed the note that indicated the class only supported running tests with QEMU, excluding hardware. Please add this link to the review as well. Scott 42620 5 srifenbark 2014-04-11 15:50:38 +0000 Hi, I incorporated both your sets of comments (Paul and Stefan) and sent out emails with notes. Can you guys look the changes over to approve? http://www.yoctoproject.org/docs/1.6/dev-manual/dev-manual.html#hardware-image-enabling-tests In that link above, there is one item I need more information on from Stefan. I have your name in there... you will see it. http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#var-TEST_IMAGE http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#var-TEST_TARGET Thanks, Scott 42745 6 srifenbark 2014-04-18 16:08:41 +0000 Hi, I worked with Stefan here to update the section on running tests. We are good now with it all. See http://www.yoctoproject.org/docs/1.6/dev-manual/dev-manual.html#performing-automated-runtime-testing. Setting the doc flag to "Done". Scott 45170 7 bogdanx.a.voiculescu 2014-08-19 11:40:58 +0000 Verified.