10588 2016-11-02 20:17:32 +0000 Exporting Tests section can lead to failed tests without proper specification 2016-11-15 00:55:36 +0000 1 1 9 Documentation Mega Manual mega-manual 2.2 x86 Multiple RESOLVED FIXED 14 Nov 2016: RESOLVED Medium major 2.3 M2 1 benjamin.esquivel srifenbark mariano.lopez srifenbark benjamin.esquivel --- --- Done (doc changes complete) oldest_to_newest 67878 0 benjamin.esquivel 2016-11-02 20:17:32 +0000 The mega manual section[1] states: """ If your image is already built, make sure the following are set in your local.conf file. Be sure to provide the IP address you need: INHERIT +="testexport" TEST_TARGET_IP = "192.168.7.2" TEST_SERVER_IP = "192.168.7.1" You can then export the tests with the following: $ bitbake core-image-sato -c testexport Exporting the tests places them in the Build Directory in tmp/testexport/core-image-sato, which is controlled by the TEST_EXPORT_DIR variable. """ This can lead to failures or confusion, at the first paragraph it is accepted that any image can be used then at further instructions it is locked-up to a particular image, in this case core-image-sato. The failure is at the test list exporting because no matter what image is selected for testing, the core-image-sato test list will be obtained always. I will place a suggestion in the next comment. [1] http://www.yoctoproject.org/docs/2.2/mega-manual/mega-manual.html#exporting-tests 67879 1 benjamin.esquivel 2016-11-02 20:26:30 +0000 Suggestion: """ You can export tests so that they can run independently of the build system. Exporting tests is required if you want to be able to hand the test execution off to a scheduler. You can only export tests that are defined in TEST_SUITES. If your image is already built (assuming core-image-sato for further instructions), make sure the following variables are set in your local.conf file: INHERIT +="testexport" TEST_TARGET_IP = "192.168.7.2" TEST_SERVER_IP = "192.168.7.1" Take into account that these are example IP addresses, it is required to be check these addresses correspond to the server and the target. The correct setup can be verified executing the ping command from host to target and from target to host. You can then export the tests with the following: $ bitbake core-image-sato -c testexport Exporting the tests places them in the Build Directory in tmp/testexport/core-image-sato, which can be controlled via the TEST_EXPORT_DIR variable. """ 67939 2 srifenbark 2016-11-03 21:12:32 +0000 Benjamin, See http://www.yoctoproject.org/docs/2.2/dev-manual/dev-manual.html#exporting-tests and let me know what you think. Thanks, Scott 67942 3 benjamin.esquivel 2016-11-03 21:53:07 +0000 It looks good to me. I'd appreciate Mariano's input as well since he wrote the feature. 68101 4 srifenbark 2016-11-08 16:54:28 +0000 Added myself to the CC list. 68114 5 mariano.lopez 2016-11-08 17:26:44 +0000 It is clearer specifying sato as the image for the example, but now it can be confusing with this part: """ Take into account that these are example IP addresses, it is required to be check these addresses correspond to the server and the target. The correct setup can be verified executing the ping command from host to target and from target to host. """ I would add: """ The IP address here will be kept as the default IPs in the configuration file generated to run the test, but can be override using the script to run the test (runexported.py) """ 68143 6 srifenbark 2016-11-08 18:16:45 +0000 Mariano, Are you looking at http://www.yoctoproject.org/docs/2.2/dev-manual/dev-manual.html#exporting-tests for the new updates? I don't see the following in the current version of the manual: """ Take into account that these are example IP addresses, it is required to be check these addresses correspond to the server and the target. The correct setup can be verified executing the ping command from host to target and from target to host. """ Is your last comment still valid about adding the following: """ The IP address here will be kept as the default IPs in the configuration file generated to run the test, but can be override using the script to run the test (runexported.py) """ Thanks, Scott 68157 7 mariano.lopez 2016-11-08 20:07:19 +0000 (In reply to comment #6) > Mariano, > > Are you looking at > http://www.yoctoproject.org/docs/2.2/dev-manual/dev-manual.html#exporting- > tests for the new updates? I don't see the following in the current version > of the manual: > I was referring to Benjamin's comment on how should end the documentation, not the current manual. 68311 8 srifenbark 2016-11-15 00:55:36 +0000 Setting to RESOLVED and putting the doc flag to "done." Scott