| Summary: | pTest - bash tests fail for 2.1_M1.rc1 | ||
|---|---|---|---|
| Product: | [QA/Testing] Runtime Testing | Reporter: | Alexandru Georgescu <alexandru.c.georgescu> |
| Component: | general | Assignee: | Changqing Li <changqing.li> |
| Status: | RESOLVED WORKSFORME | QA Contact: | |
| Severity: | normal | ||
| Priority: | Medium | CC: | chong.lu, francisco.j.pedraza.gonzalez, jair.de.jesus.gonzalez.plascencia, liezhi.yang, richard.purdie, sgw, yi.zhao |
| Version: | 2.1 | ||
| Target Milestone: | 2.7 M2 | ||
| Hardware: | NUC | ||
| OS: | x86_64 | ||
| Whiteboard: | |||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | Don't know | |
|
Description
Alexandru Georgescu
2015-12-17 10:07:26 UTC
Tested with 2.0.1.rc2: poky: dd0ba9ea4a11ab15348d4fe3574e4b28784db82f previous commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1 Results for NUC ptest bash 2016-01-18: ******************************** Tests that failed now and worked last time: 2 run-builtins run-printf Tests that failed now: 9 run-assoc run-builtins run-printf run-intl run-coproc run-lastpipe run-test run-trap run-execscript (In reply to comment #0) > Commit: 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e > Previous Commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1 > > > https://wiki.yoctoproject.org/wiki/ > Ptest_5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e > > Results for NUC ptest bash 2015-12-10: > ******************************** > Tests that failed now and worked last time: 5 > run-nquote1 > run-builtins > run-printf > run-type > run-read > Tests that passed now and and failed last time: 0 > > Tests that were skipped now and worked last time: 0 > > Tests that were skipped last time and worked now: 0 > Tests that failed now: 12 > run-assoc > run-nquote1 > run-builtins > run-printf > run-intl > run-coproc > run-lastpipe > run-type > run-read > run-test > run-trap > run-execscript Here are the results for YP 2.1_M2.rc1 AB Link: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1_M2.rc1/ptest/machines/genericx86-64/core-image-sato-sdk-genericx86-64.hddimg https://wiki.yoctoproject.org/wiki/Ptest_3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c Ptest 3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c Ran on a NUC and compared with commit 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e Tests that passed now and and failed last time: 7 run-assoc run-nquote1 run-coproc run-type run-read run-test run-execscript Tests that were skipped now and worked last time: 0 Tests that were skipped last time and worked now: 0 Tests that failed now: 5 run-builtins run-printf run-intl run-lastpipe run-trap There are 4 tests still failing on 2.3 M3 rc2. ********** Failures ******* FAIL: run-intl FAIL: run-lastpipe FAIL: run-trap FAIL: run-vredir *************************** Results: https://wiki.yoctoproject.org/wiki/Ptest_6e20b31d5d17133e0fca086e12a0ad06ab5c4cc8 Correcting the link for results on 2.3 M3 rc2: https://wiki.yoctoproject.org/wiki/Ptest_415b72ffcbd26e5f3664370d8b2a9b8105fb6342 *** Bug 5698 has been marked as a duplicate of this bug. *** only have 2 failed now, and these two failed are not real fail. 1. for run-trap, it have warning, only line number difference is not real fail. run-trap warning: UNIX versions number signals and schedule processes differently. warning: If output differing only in line numbers is produced, please warning: do not consider this a test failure. 71,72d70 < +[8] false < +[8] cat 73a72,73 > +[8] cat > +[8] false 2. this is failed since run ptest as root user, it can pass with non-root user . According to upstream comments, the whole test should run under non-root user. run-new-exp warning: two of these tests will fail if your OS does not support warning: named pipes or the /dev/fd filesystem. If the tests of the warning: process substitution mechanism fail, please do not consider warning: this a test failure warning: if you have exported variables beginning with the string _Q, warning: diff output may be generated. If so, please do not consider warning: this a test failure 627c627 < argv[1] = <host(2)[4.4]# > --- > argv[1] = <host(2)[4.4]$ > FAIL: run-new-exp |