Bug 14800

Summary: AB-INT PTEST: libgcrypt ptest intermittent failure
Product: [QA/Testing] Package Testing (ptest) Reporter: Luca Ceresoli <luca.ceresoli>
Component: ptestAssignee: Ross Burton <ross.burton>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: High CC: alexandre.belloni, jon.mason, luca.ceresoli, randy.macleod, richard.purdie
Version: unspecified   
Target Milestone: 4.1 M4   
Hardware: x86   
OS: arm64   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
libgcrypt ptest log none

Description Luca Ceresoli 2022-05-13 08:31:47 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3242/steps/12/logs/stdio

qemuarm64-ptest on ubuntu1804-arm-1

sdtio log excerpt:

WARNING: core-image-ptest-all-1.0-r0 do_testimage: There were failing ptests.
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner
    self.fail(failmsg)
AssertionError: Failed ptests:
{'libgcrypt': '2022-05-12T08:56\n'
              '2022-05-12T08:56\n'
              'make: Entering directory '
              "'/usr/lib/libgcrypt/ptest/build/tests'\n"
              'cd .. && make  am--refresh\n'
              'version:1.10.1-unknown:10a01:1.45-unknown:12d00:\n'
              'cc:120100:gcc:12.1.0:\n'

[...]

              'ERROR: Exit status is 9\n'
              'DURATION: 587\n'}
Cannot run ptests without @expectedFailure as ptests are expected to fail
Output from runqemu:
runqemu - INFO - SIGTERM received
runqemu - INFO - Cleaning up
runqemu - INFO - Removing /home/pokybuild/tmp/core-image-ptest-all-qemuarm64.ext4.65231
tput: No value for $TERM and no -T specified
RESULTS:
RESULTS - ping.PingTest.test_ping: PASSED (0.08s)
RESULTS - ssh.SSHTest.test_ssh: PASSED (0.35s)
RESULTS - ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s)
RESULTS - ptest.PtestRunnerTest.test_ptestrunner_expectfail: EXPECTEDFAIL (14873.46s)
SUMMARY:
core-image-ptest-all () - Ran 4 tests in 14873.908s
core-image-ptest-all - OK - All required tests passed (successes=2, skipped=1, failures=0, errors=0)
NOTE: recipe core-image-ptest-all-1.0-r0: task do_testimage: Succeeded
NOTE: Tasks Summary: Attempted 1094 tasks of which 1093 didn't need to be rerun and all succeeded.
Summary: There was 1 WARNING message.
program finished with exit code 0
elapsedTime=14921.366512
Comment 1 Luca Ceresoli 2022-07-25 12:43:00 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3552/steps/12/logs/stdio

qemuarm64-ptest on ubuntu2204-arm-1

master-next
Comment 2 Luca Ceresoli 2022-07-26 19:01:49 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3563/steps/12/logs/stdio

qemuarm64-ptest on ubuntu1804-arm-1
Comment 3 Alexandre Belloni 2022-08-11 12:24:28 UTC
Created attachment 4894 [details]
libgcrypt ptest log
Comment 4 Alexandre Belloni 2022-08-11 12:25:02 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3530/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1

Is it suddenly rebooting?
Comment 5 Alexandre Belloni 2022-08-11 12:37:13 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3535/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 6 Alexandre Belloni 2022-08-11 12:57:59 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3552/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 7 Alexandre Belloni 2022-08-11 13:13:31 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3554/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 8 Alexandre Belloni 2022-08-11 13:20:23 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3625/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 9 Richard Purdie 2022-08-15 15:19:36 UTC
Jon: Any chance you can help with this since Ross is still out?
Comment 10 Alexandre Belloni 2022-08-16 17:09:09 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/3628/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 11 Alexandre Belloni 2022-08-16 19:52:05 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3629/steps/12/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 12 Ross Burton 2022-08-17 12:15:43 UTC
I've some cleanups to the test suite to make it generally better, and appear to have isolated the keygen test as a common culprit
Comment 13 Alexandre Belloni 2022-08-17 14:29:44 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3670/steps/12/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 14 Alexandre Belloni 2022-08-17 14:42:27 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/3674/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 15 Alexandre Belloni 2022-08-18 09:30:57 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3687/steps/12/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 16 Alexandre Belloni 2022-08-18 09:33:02 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3682/steps/12/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 17 Alexandre Belloni 2022-08-24 15:57:04 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/3703/steps/12/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 18 Luca Ceresoli 2022-08-25 08:26:40 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3715/steps/12/logs/stdio

qemuarm64-ptest on ubuntu2204-arm-1
Comment 19 Luca Ceresoli 2022-08-25 13:56:39 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3718/steps/12/logs/stdio

qemuarm64-ptest on ubuntu2204-arm-1
Comment 20 Luca Ceresoli 2022-08-26 17:23:57 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3726/steps/12/logs/stdio

qemuarm64-ptest on ubuntu2204-arm-1
Comment 21 Richard Purdie 2022-09-03 12:20:22 UTC
Hoping https://git.yoctoproject.org/poky/commit/?id=ae0b0649aa6db8045995a6f323a2ad88bb17befa resolves this. Reopen if recurs on master.
Comment 22 Alexandre Belloni 2022-09-08 14:16:13 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3778/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 23 Alexandre Belloni 2022-09-08 14:16:58 UTC
Reopening as it reoccurred
Comment 24 Ross Burton 2022-09-09 11:43:01 UTC
Another patch sent to disable the bench-slope test, as this appears to be the one that crashes.

If this is the case, further work is needed to figure out why.
Comment 25 Alexandre Belloni 2022-09-22 12:48:30 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3783/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1


https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/3792/steps/12/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1

Both from 2022-09-09
Comment 26 Ross Burton 2022-09-22 13:58:52 UTC
Those builds are before the "fix" landed (oe-core 85bea6d2b4d54564ae5ba671dfb5b533ce8ab7a8).

Closing hopefully for good this time.