Insert some abstraction between the request to run a test and the launching of it in QEMU so that we can also run the test on real hardware. How the test should be run should be able to be set via a variable, and the variable's value should map to a python class with the implementation of how the image should be deployed and booted. We should create two initial implementations: 1) A QEMU implementation (does what it does currently) 2) A very simple remote implementation which does not deploy the image but runs the tests on a remote machine via ssh to a specified IP address. In the current code there's a fair amount of isolation here already so this shouldn't be too tricky.
Patches on the ML.
http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=b4d9b4208b1c06164c4eeea2110408fb404dba1c http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=17e3dc2cb5e7c060647a29a508d43a622ba53b80
Hi, I have added several areas to address this documentation part of the bug based on Stefan's email he sent me. The new sections need a good review. I had some difficulty unwrapping the raw information into individual sections so please look it over and comment: http://www.yoctoproject.org/docs/1.6/dev-manual/dev-manual.html#performing-automated-runtime-testing - This is the main section on running tests in the dev-manual. It now needs to cover qemu and actual hardware. I suspect we need to work on this section some more. These next links are to the new variables. http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#var-TEST_TARGET http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_TARGET_IP http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_SERVER_IP http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_LOG_DIR http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_EXPORT_ONLY http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#TEST_EXPORT_DIR
Hi, I realized that this area in the manual also needed adjusting based on the ability to now run tests on hardware - http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#ref-classes-testimage. I basically removed the note that indicated the class only supported running tests with QEMU, excluding hardware. Please add this link to the review as well. Scott
Hi, I incorporated both your sets of comments (Paul and Stefan) and sent out emails with notes. Can you guys look the changes over to approve? http://www.yoctoproject.org/docs/1.6/dev-manual/dev-manual.html#hardware-image-enabling-tests In that link above, there is one item I need more information on from Stefan. I have your name in there... you will see it. http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#var-TEST_IMAGE http://www.yoctoproject.org/docs/1.6/ref-manual/ref-manual.html#var-TEST_TARGET Thanks, Scott
Hi, I worked with Stefan here to update the section on running tests. We are good now with it all. See http://www.yoctoproject.org/docs/1.6/dev-manual/dev-manual.html#performing-automated-runtime-testing. Setting the doc flag to "Done". Scott
Verified.