| Summary: | AB-INT PTEST: valgrind failed helgrind/tests/hg05_race2 | ||
|---|---|---|---|
| Product: | [QA/Testing] Package Testing (ptest) | Reporter: | Chee Yang <chee.yang.lee> |
| Component: | ptest | Assignee: | Randy MacLeod <randy.macleod> |
| Status: | RESOLVED WONTFIX | QA Contact: | |
| Severity: | normal | ||
| Priority: | Medium+ | CC: | alexandre.belloni, jay.shen.teoh, jon.mason, leonardo.sandoval, meta.mr.watcher, meta.watcher, oobitots, randy.macleod, richard.purdie |
| Version: | unspecified | ||
| Target Milestone: | --- | ||
| Hardware: | x86 | ||
| OS: | Multiple | ||
| Whiteboard: | AB-INT | ||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | Don't know | |
another occurance with different test
{'valgrind': ['helgrind/tests/tc09_bad_unlock']}
qemux86-64-ptest
ubuntu2004-ty-2
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2080/steps/12/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2096/steps/12/logs/stdio qemux86-64-ptest tumbleweed-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2112/ qemux86-64-ptest tumbleweed-ty-3 (In reply to comment #5) > https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2112/ > > qemux86-64-ptest > tumbleweed-ty-3 Note: that link is incomplete, the build log is available at https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2112/steps/12/logs/stdio Interestingly, it's not just the hg05 test failing this time, I'll look into the drd test as well to see if there's a similarity. I have contacted upstream about the failing hg05_race2 test, and it looks like it has been happening for a while. Here is the original upstream report: https://bugs.kde.org/show_bug.cgi?id=345121 I have been able to reproduce the failing test for both hg05 and tc09, running it with their testing harness usually causes it to fail within a few runs, and it consistently produces the invalid output if run using strace -f. Both of the tests fail with outputs differing by 1/2 lines. The diffs for the invalid output from qemu, an Intel desktop and my Ryzen laptop fail in the same way, so I don't think it's specific to our build process. That being said, it does have to do with the ordering of threads required for an unwinding step them as per upstream. I'll see if I can come up with a solution or workaround to stop the failing builds. https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2169/steps/12/logs/stdio qemux86-64-ptest tumbleweed-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2274/steps/12/logs/stdio qemux86-64-ptest debian10-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2279/steps/12/logs/stdio qemux86-64-ptest debian10-ty-2 'valgrind': ['helgrind/tests/hg05_race2', 'helgrind/tests/tc09_bad_unlock'] These two ptests were also failing on QA for yocto-3.3.2.rc2 : 1. ptestresult.valgrind.helgrind/tests/hg05_race2: PASSED -> FAILED 2. ptestresult.valgrind.helgrind/tests/tc09_bad_unlock: PASSED -> FAILED backport taskset work-around to 3.3 please Tony. (In reply to comment #12) > backport taskset work-around to 3.3 please Tony. The change was already backported to Hardknott (3.3) some time ago: http://cgit.openembedded.org/openembedded-core/commit/meta/recipes-devtools/valgrind/valgrind/?h=hardknott&id=79ec1d73a107277586d3d8e9c0d46dfc0ac2b0d8 http://cgit.openembedded.org/openembedded-core/commit/meta/recipes-devtools/valgrind/valgrind/?h=hardknott&id=f076edb7515ba2ecfc0adbfdf30ae5a9aa96e231 It's not perfect, and the tests do still fail occasionally, but it does seem to improve the situation. hardknott
{'valgrind': ['helgrind/tests/hg05_race2', 'helgrind/tests/tc09_bad_unlock']}
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2786/steps/12/logs/stdio
need to backport the taskset depenedency to previous releases. https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3133/steps/13/logs/stdio qemux86-64-ptest ubuntu1604-ty-1 WARNING: core-image-sato-sdk-ptest-1.0-r0 do_testimage: There were failing ptests. Traceback (most recent call last): File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail self.do_ptestrunner() File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner self.fail(failmsg) AssertionError: Failed ptests: {'valgrind': ['helgrind/tests/hg05_race2', 'helgrind/tests/tc09_bad_unlock']} https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3401/steps/12/logs/stdio │ ubuntu1604-ty-1 │ Non-SSD │ (In reply to comment #17) > https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3401/steps/ > 12/logs/stdio > > │ ubuntu1604-ty-1 │ Non-SSD │ Just to note, the above was hardknott hardknott is at EOL and I think this particualar issue is worked-around in later branches. |
Traceback (most recent call last): File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 36, in wrapped_f return func(*args, **kwargs) File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail self.do_ptestrunner() File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner self.fail(failmsg) AssertionError: Failed ptests: {'valgrind': ['helgrind/tests/hg05_race2']} https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2069/steps/12/logs/stdio