| Summary: | selftest: some testexport tests need a previous build to run | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [QA/Testing] Build Testing | Reporter: | Benjamin Esquivel <benjamin.esquivel> | ||||
| Component: | general | Assignee: | Jose Perez C <jose.perez.carranza> | ||||
| Status: | RESOLVED NOTABUG | QA Contact: | |||||
| Severity: | enhancement | ||||||
| Priority: | Medium | CC: | anibal.limon, benjamin.esquivel, joshuagloe, leonardo.sandoval.gonzalez, mariano.lopez, monserratx.sedeno.bustos | ||||
| Version: | 2.3 | ||||||
| Target Milestone: | 2.3 M4 | ||||||
| Hardware: | x86 | ||||||
| OS: | Multiple | ||||||
| Whiteboard: | |||||||
| OS type for building Yocto: | --- | Type of Regression: | --- | ||||
| Verified: | Documentation change: | No (bug/feature does not impact docs) | |||||
| Bug Depends on: | |||||||
| Bug Blocks: | 10937 | ||||||
| Attachments: |
|
||||||
Above tests were carried on in an AB worker with opensuse421 step 3 on the first comment needs an update: 3. execute an oe-selftest session with only these tests in the filter. $ oe-selftest -r runtime-test.TestExport.test_testexport_basic $ oe-selftest -r runtime-test.TestExport.test_testexport_sdk I tried to reproduce running selftest manually, using a brand new cloned poky with and without sstates; I wasn't able to trigger the error. Is there a log message that can give us an insight what is going on? I remember that some days ago testexport was broken, perhaps you are seeing these errors? I'll ask for a staging autobuilder job to see if it is fixed. Created attachment 3645 [details]
local AB execution
(In reply to comment #5) > Created attachment 3645 [details] > local AB execution Bug was not reproduced anymore on local machine neither local AB, as Mariano says in Comment 3, testexport was broken and this may be the cause of the failures. Closing as not a bug. |
The following tests are failing because of the need of a previous build to run and pass: > 1. FAIL [104.180s]: test_testexport_sdk (oeqa.selftest.runtime- > test.TestExport) > 2. FAIL [128.437s]: test_testexport_basic (oeqa.selftest.runtime- > test.TestExport) Tests should be self-sufficient to run by minimizing the user needing to do specific actions that the test can do, like a dependency on an image built prior testing. Procedure to reproduce: 1. download a fresh yoctproject poky clone 2. init the build environment 3. execute an oe-selftest session with only these tests in the filter. $ oe-selftest -r oeqa.selftest.runtime-test.TestExport.test_testexport_basic $ oe-selftest -r oeqa.selftest.runtime-test.TestExport.test_testexport_sdk Expected outcome: the test passes. Actual outcome: the test fails. Workaround: prior step 3, build a core-image-sato