8194 2015-08-21 09:14:00 +0000 'FakeTarget' object has no attribute 'run_serial' 2015-10-12 03:34:03 +0000 1 1 10 QA/Testing Runtime Testing general 1.8.1 x86 Multiple CLOSED DUPLICATE 8203 Undecided critical --- 8212 1 junhuix.zhang mariano.lopez cathy.shen daniel.alexandrux.istrate daweix.wu mariano.lopez daniel.alexandrux.istrate --- --- No (bug/feature does not impact docs) oldest_to_newest 53312 0 junhuix.zhang 2015-08-21 09:14:00 +0000 When we use SimpleRemoteTarget or FakeTarget to run our testing. It will have this ERROR: Traceback (most recent call last): File "/home/tester/Iot-auto/Iot_test_suites/gb_168full/iottest/oeqa/oetest.py", line 125, in tearDown self.dump_target_logs() File "/home/tester/Iot-auto/Iot_test_suites/gb_168full/iottest/oeqa/oetest.py", line 150, in dump_target_logs (status, output) = self.target.run_serial(comm) AttributeError: 'FakeTarget' object has no attribute 'run_serial' 53373 1 junhuix.zhang 2015-08-25 07:00:32 +0000 reproduce condition: at least a error or a fail test case. Another issue: If this happens, It will block posterior test cases. It because an if sentence in oeRuntimeTest's teawDown: if (self._resultForDoCleanups.failures or self._resultForDoCleanups.errors): self.dump_target_logs() In this sentence we must notice that self._resultForDoCleanups.failures and self._resultForDoCleanups.errors were lists, these two lists contain test cases have already failed or in error, so when an error(or fail) happens, this if is always true, and self.dump_target_logs() will always be executed. 53374 2 junhuix.zhang 2015-08-25 07:01:52 +0000 reproduce condition: at least a error or a fail test case. Another issue: If this happens, It will block posterior test cases. It because an if sentence in oeRuntimeTest's teawDown: if (self._resultForDoCleanups.failures or self._resultForDoCleanups.errors): self.dump_target_logs() In this sentence we must notice that self._resultForDoCleanups.failures and self._resultForDoCleanups.errors were lists, these two lists contain test cases have already failed or in error, so when an error(or fail) happens, this if is always true, and self.dump_target_logs() will always be executed. 53376 3 cathy.shen 2015-08-25 09:42:31 +0000 I'm afraid this issue is easy to be reproduced and impact test a lot once there is fail cases, pls. prioritize the fixing. 53419 4 daniel.alexandrux.istrate 2015-08-26 14:22:39 +0000 Hi, This issue seem to be similar with the one seen in bug 8203. Please take a look at that and apply those patches and see if it works. I tested with TEST_TARGET = "simpleremote", I am not so sure about fake target. Thanks, --Daniel 53424 5 mariano.lopez 2015-08-26 14:49:44 +0000 As Daniel mentioned in the last comment the patches in bug 8203 fix the simple remote bug, unfortunately they introduced another one when generating the exported test. I'm currently working on this. 53426 6 mariano.lopez 2015-08-26 15:12:55 +0000 Are you able to run exported tests? I'm not able to run them at all. For me it can't find module bb. If you are able to run it please let me know how. 53435 7 mariano.lopez 2015-08-26 16:50:02 +0000 I performed more testing. Trying with current master I get this traceback when I try to run the runexported.py script: $ ./runexported.py testdata.json Traceback (most recent call last): File "./runexported.py", line 33, in <module> from oeqa.oetest import runTests File "/home/mlopezva/otc/repo/poky/bug8118/tmp/testimage/core-image-sato/oeqa/oetest.py", line 14, in <module> import bb ImportError: No module named bb Using bb for logging was introduced in 058e75d60e98841c8532a05006ae46725e3cdfd1. If I try before that commit I get this trace: $ ./runexported.py testdata.json SSH log file: /home/mlopezva/repo/poky/temp/tmp/testimage/core-image-sato/ssh_target_log.20150826075658 Traceback (most recent call last): File "./runexported.py", line 135, in <module> ret = main() File "./runexported.py", line 129, in main runTests(tc) File "/home/mlopezva/repo/poky/temp/tmp/testimage/core-image-sato/oeqa/oetest.py", line 35, in runTests suite = loadTests(tc, type) File "/home/mlopezva/repo/poky/temp/tmp/testimage/core-image-sato/oeqa/oetest.py", line 29, in loadTests suite = testloader.loadTestsFromNames(tc.testslist) File "/usr/lib64/python2.7/unittest/loader.py", line 130, in loadTestsFromNames suites = [self.loadTestsFromName(name, module) for name in names] AttributeError: 'module' object has no attribute 'buildcvs' That is why I need to know how do you test using FakeTarget. I have a patch that I think solves the issue that will be introduced with the patches of bug 8203 but I don't have a way to testing it. 53446 8 mariano.lopez 2015-08-26 20:31:18 +0000 Bug 8212 opened for the exported case test. 53460 9 junhuix.zhang 2015-08-27 01:17:08 +0000 (In reply to comment #7) > I performed more testing. Trying with current master I get this traceback > when I try to run the runexported.py script: > > $ ./runexported.py testdata.json > Traceback (most recent call last): > File "./runexported.py", line 33, in <module> > from oeqa.oetest import runTests > File > "/home/mlopezva/otc/repo/poky/bug8118/tmp/testimage/core-image-sato/oeqa/ > oetest.py", line 14, in <module> > import bb > ImportError: No module named bb > > > Using bb for logging was introduced in > 058e75d60e98841c8532a05006ae46725e3cdfd1. > If I try before that commit I get this trace: > > $ ./runexported.py testdata.json > SSH log file: > /home/mlopezva/repo/poky/temp/tmp/testimage/core-image-sato/ssh_target_log. > 20150826075658 > Traceback (most recent call last): > File "./runexported.py", line 135, in <module> > ret = main() > File "./runexported.py", line 129, in main > runTests(tc) > File > "/home/mlopezva/repo/poky/temp/tmp/testimage/core-image-sato/oeqa/oetest.py", > line 35, in runTests > suite = loadTests(tc, type) > File > "/home/mlopezva/repo/poky/temp/tmp/testimage/core-image-sato/oeqa/oetest.py", > line 29, in loadTests > suite = testloader.loadTestsFromNames(tc.testslist) > File "/usr/lib64/python2.7/unittest/loader.py", line 130, in > loadTestsFromNames > suites = [self.loadTestsFromName(name, module) for name in names] > AttributeError: 'module' object has no attribute 'buildcvs' > > > That is why I need to know how do you test using FakeTarget. I have a patch > that I think solves the issue that will be introduced with the patches of > bug 8203 but I don't have a way to testing it. Yes, we had found this issue before, But we use our scripts to export test suites, so we fixed this issue in our scripts 53509 10 2691 mariano.lopez 2015-08-27 20:59:13 +0000 Created attachment 2691 This patch will allow to runexported script compatible with host dump This is a patch allows to work exported test with host dump. Notice that I won't fix current broken export tests feature. I think you will need to rebase to patch to work with your scripts. Please note this patch requires http://lists.openembedded.org/pipermail/openembedded-core/2015-August/109376.html 53510 11 mariano.lopez 2015-08-27 21:00:43 +0000 I will mark as duplicate of bug 8203 because the same series of patches broke the hardware test functionality. *** This bug has been marked as a duplicate of bug 8203 *** 55152 12 cathy.shen 2015-10-12 03:34:03 +0000 Close this ticket since it's fixed. 2691 2015-08-27 20:59:13 +0000 2015-08-27 20:59:13 +0000 This patch will allow to runexported script compatible with host dump 0006-runexported-Make-it-compatible-with-host-dump.patch text/plain 3715 mariano.lopez RnJvbSA0NTRkNDRiZjk4YzhmNjkxM2JhN2U0ZGExNDg1ODk1NTE2NzEzNjI3IE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBNYXJpYW5vIExvcGV6IDxtYXJpYW5vLmxvcGV6QGxpbnV4Lmlu dGVsLmNvbT4KRGF0ZTogVGh1LCAyNyBBdWcgMjAxNSAwOToxMDoyMSArMDAwMApTdWJqZWN0OiBb UEFUQ0ggNi82XSBydW5leHBvcnRlZDogTWFrZSBpdCBjb21wYXRpYmxlIHdpdGggaG9zdCBkdW1w CgpUaGlzIHdpbGwgYWxsb3cgdG8gdXNlIHRoZSBIb3N0RHVtcGVyIHdoZW4gcnVubmluZwphIGV4 cG9ydGVkIHRlc3QuCgpbWU9DVE8gIzgxMThdCgpTaWduZWQtb2ZmLWJ5OiBNYXJpYW5vIExvcGV6 IDxtYXJpYW5vLmxvcGV6QGxpbnV4LmludGVsLmNvbT4KLS0tCiBtZXRhL2NsYXNzZXMvdGVzdGlt YWdlLmJiY2xhc3MgfCA2ICsrKysrLQogbWV0YS9saWIvb2VxYS9vZXRlc3QucHkgICAgICAgIHwg MyArLS0KIG1ldGEvbGliL29lcWEvcnVuZXhwb3J0ZWQucHkgICB8IDggKysrKysrKy0KIDMgZmls ZXMgY2hhbmdlZCwgMTMgaW5zZXJ0aW9ucygrKSwgNCBkZWxldGlvbnMoLSkKCmRpZmYgLS1naXQg YS9tZXRhL2NsYXNzZXMvdGVzdGltYWdlLmJiY2xhc3MgYi9tZXRhL2NsYXNzZXMvdGVzdGltYWdl LmJiY2xhc3MKaW5kZXggNmE0YjgwYS4uNTdjZDc4NiAxMDA2NDQKLS0tIGEvbWV0YS9jbGFzc2Vz L3Rlc3RpbWFnZS5iYmNsYXNzCisrKyBiL21ldGEvY2xhc3Nlcy90ZXN0aW1hZ2UuYmJjbGFzcwpA QCAtMTczLDkgKzE3MywxMCBAQCBkZWYgZXhwb3J0VGVzdHMoZCx0Yyk6CiAgICAgc2F2ZWRhdGEg PSB7fQogICAgIHNhdmVkYXRhWyJkIl0gPSB7fQogICAgIHNhdmVkYXRhWyJ0YXJnZXQiXSA9IHt9 CisgICAgc2F2ZWRhdGFbImhvc3RfZHVtcGVyIl0gPSB7fQogICAgIGZvciBrZXkgaW4gdGMuX19k aWN0X186CiAgICAgICAgICMgc3BlY2lhbCBjYXNlcwotICAgICAgICBpZiBrZXkgIT0gImQiIGFu ZCBrZXkgIT0gInRhcmdldCI6CisgICAgICAgIGlmIGtleSAhPSAiZCIgYW5kIGtleSAhPSAidGFy Z2V0IiBhbmQga2V5ICE9ICJob3N0X2R1bXBlciI6CiAgICAgICAgICAgICBzYXZlZGF0YVtrZXld ID0gZ2V0YXR0cih0Yywga2V5KQogICAgIHNhdmVkYXRhWyJ0YXJnZXQiXVsiaXAiXSA9IHRjLnRh cmdldC5pcCBvciBkLmdldFZhcigiVEVTVF9UQVJHRVRfSVAiLCBUcnVlKQogICAgIHNhdmVkYXRh WyJ0YXJnZXQiXVsic2VydmVyX2lwIl0gPSB0Yy50YXJnZXQuc2VydmVyX2lwIG9yIGQuZ2V0VmFy KCJURVNUX1NFUlZFUl9JUCIsIFRydWUpCkBAIC0xODksNiArMTkwLDkgQEAgZGVmIGV4cG9ydFRl c3RzKGQsdGMpOgogICAgICAgICAgICAgIyB3ZSBkb24ndCBjYXJlIGFib3V0IHRob3NlIGFueXdh eQogICAgICAgICAgICAgcGFzcwogCisgICAgc2F2ZWRhdGFbImhvc3RfZHVtcGVyIl1bInBhcmVu dF9kaXIiXSA9IHRjLmhvc3RfZHVtcGVyLnBhcmVudF9kaXIKKyAgICBzYXZlZGF0YVsiaG9zdF9k dW1wZXIiXVsiY21kcyJdID0gdGMuaG9zdF9kdW1wZXIuY21kcworCiAgICAgd2l0aCBvcGVuKG9z LnBhdGguam9pbihleHBvcnRwYXRoLCAidGVzdGRhdGEuanNvbiIpLCAidyIpIGFzIGY6CiAgICAg ICAgICAgICBqc29uLmR1bXAoc2F2ZWRhdGEsIGYsIHNraXBrZXlzPVRydWUsIGluZGVudD00LCBz b3J0X2tleXM9VHJ1ZSkKIApkaWZmIC0tZ2l0IGEvbWV0YS9saWIvb2VxYS9vZXRlc3QucHkgYi9t ZXRhL2xpYi9vZXFhL29ldGVzdC5weQppbmRleCBmNTQxMTM2Li5mMTM4Y2E3IDEwMDY0NAotLS0g YS9tZXRhL2xpYi9vZXFhL29ldGVzdC5weQorKysgYi9tZXRhL2xpYi9vZXFhL29ldGVzdC5weQpA QCAtMTMsNyArMTMsNiBAQCBpbXBvcnQgaW5zcGVjdAogaW1wb3J0IHN1YnByb2Nlc3MKIGltcG9y dCBiYgogZnJvbSBvZXFhLnV0aWxzLmRlY29yYXRvcnMgaW1wb3J0IExvZ1Jlc3VsdHMKLWZyb20g b2VxYS50YXJnZXRjb250cm9sIGltcG9ydCBRZW11VGFyZ2V0CiBmcm9tIHN5cyBpbXBvcnQgZXhj X2luZm8sIGV4Y19jbGVhcgogCiBkZWYgbG9hZFRlc3RzKHRjLCB0eXBlPSJydW50aW1lIik6CkBA IC0xMjYsNyArMTI1LDcgQEAgY2xhc3Mgb2VSdW50aW1lVGVzdChvZVRlc3QpOgogICAgICAgICAg ICAgc2VsZi50Yy5ob3N0X2R1bXBlci5jcmVhdGVfZGlyKHNlbGYuX3Rlc3RNZXRob2ROYW1lKQog ICAgICAgICAgICAgc2VsZi50Yy5ob3N0X2R1bXBlci5kdW1wX2hvc3QoKQogICAgICAgICAgICAg I09ubHkgUWVtdVRhcmdldCBoYXMgYSBzZXJpYWwgY29uc29sZQotICAgICAgICAgICAgaWYgKGlz aW5zdGFuY2Uoc2VsZi50YXJnZXQsIFFlbXVUYXJnZXQpKToKKyAgICAgICAgICAgIGlmICh0eXBl KHNlbGYudGFyZ2V0KS5fX25hbWVfXyA9PSAiUWVtdVRhcmdldCIpOgogICAgICAgICAgICAgICAg IHNlbGYudGFyZ2V0LnRhcmdldF9kdW1wZXIuZHVtcF90YXJnZXQoCiAgICAgICAgICAgICAgICAg ICAgICAgICBzZWxmLnRjLmhvc3RfZHVtcGVyLmR1bXBfZGlyKQogICAgICAgICAgICAgcHJpbnQg KCIlcyBkdW1wIGRhdGEgc3RvcmVkIGluICVzIiAlIChzZWxmLl90ZXN0TWV0aG9kTmFtZSwKZGlm ZiAtLWdpdCBhL21ldGEvbGliL29lcWEvcnVuZXhwb3J0ZWQucHkgYi9tZXRhL2xpYi9vZXFhL3J1 bmV4cG9ydGVkLnB5CmluZGV4IGUxYjY2NDIuLjk2NDQyYjEgMTAwNzU1Ci0tLSBhL21ldGEvbGli L29lcWEvcnVuZXhwb3J0ZWQucHkKKysrIGIvbWV0YS9saWIvb2VxYS9ydW5leHBvcnRlZC5weQpA QCAtMzIsNiArMzIsNyBAQCBzeXMucGF0aC5hcHBlbmQob3MucGF0aC5hYnNwYXRoKG9zLnBhdGgu am9pbihvcy5wYXRoLmRpcm5hbWUoX19maWxlX18pLCAib2VxYSIpKQogCiBmcm9tIG9lcWEub2V0 ZXN0IGltcG9ydCBydW5UZXN0cwogZnJvbSBvZXFhLnV0aWxzLnNzaGNvbnRyb2wgaW1wb3J0IFNT SENvbnRyb2wKK2Zyb20gb2VxYS51dGlscy5kdW1wIGltcG9ydCBnZXRfaG9zdF9kdW1wZXIKIAog IyB0aGlzIGlzbid0IHByZXR0eSBidXQgd2UgbmVlZCBhIGZha2UgdGFyZ2V0IG9iamVjdAogIyBm b3IgcnVubmluZyB0aGUgdGVzdHMgZXh0ZXJuYWxseSBhcyB3ZSBkb24ndCBjYXJlCkBAIC0xMTgs MTEgKzExOSwxNiBAQCBkZWYgbWFpbigpOgogICAgIGZvciBrZXkgaW4gbG9hZGVkWyJ0YXJnZXQi XS5rZXlzKCk6CiAgICAgICAgIHNldGF0dHIodGFyZ2V0LCBrZXksIGxvYWRlZFsidGFyZ2V0Il1b a2V5XSkKIAorICAgIGhvc3RfZHVtcGVyID0gZ2V0X2hvc3RfZHVtcGVyKGQpCisgICAgaG9zdF9k dW1wZXIucGFyZW50X2RpciA9IGxvYWRlZFsiaG9zdF9kdW1wZXIiXVsicGFyZW50X2RpciJdCisg ICAgaG9zdF9kdW1wZXIuY21kcyA9IGxvYWRlZFsiaG9zdF9kdW1wZXIiXVsiY21kcyJdCisKICAg ICB0YyA9IFRlc3RDb250ZXh0KCkKICAgICBzZXRhdHRyKHRjLCAiZCIsIGQpCiAgICAgc2V0YXR0 cih0YywgInRhcmdldCIsIHRhcmdldCkKKyAgICBzZXRhdHRyKHRjLCAiaG9zdF9kdW1wZXIiLCBo b3N0X2R1bXBlcikKICAgICBmb3Iga2V5IGluIGxvYWRlZC5rZXlzKCk6Ci0gICAgICAgIGlmIGtl eSAhPSAiZCIgYW5kIGtleSAhPSAidGFyZ2V0IjoKKyAgICAgICAgaWYga2V5ICE9ICJkIiBhbmQg a2V5ICE9ICJ0YXJnZXQiIGFuZCBrZXkgIT0gImhvc3RfZHVtcGVyIjoKICAgICAgICAgICAgIHNl dGF0dHIodGMsIGtleSwgbG9hZGVkW2tleV0pCiAKICAgICB0YXJnZXQuZXhwb3J0U3RhcnQoKQot LSAKMS45LjEKCg==