Created attachment 4165 [details] trimmed The test installs and removes a package via RPM ten times, then checks /var/log/messages for lines containing "RPM", and asserts it is above 80. The test failed with the following: | DEBUG: [Running]$ ssh -l root -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR 192.168.7.4 export PATH=/usr/sbin:/sbin:/usr/bin:/bin; grep RPM /var/log/messages | wc -l | DEBUG: time: 1515073163.2173557, endtime: 1515073463.2118435 | DEBUG: Partial data from SSH call: 57 | | DEBUG: time: 1515073163.279065, endtime: 1515073463.279062 | DEBUG: [Command returned '0' after 0.07 seconds] | DEBUG: Command: grep RPM /var/log/messages | wc -l | Output: 57 Autobuilder link here: https://autobuilder.yocto.io/builders/nightly-x86/builds/702/steps/Running%20Sanity%20Tests/logs/stdio Trimmed and full version of log attached.
Created attachment 4166 [details] full log
This test is pretty poor, we really need a better one which generates and tests for specific log messages. I suspect something else happened and was logged and this reduced the count. If the test fails, dumping the contents of the log would be very very useful too.
Also happened for https://autobuilder.yocto.io/builders/nightly-rpm-non-rpm/builds/682 so this is recurring
Again in, https://autobuilder.yoctoproject.org/typhoon/#/builders/74/builds/3155/steps/14/logs/stdio
Reocurrence in https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2374/steps/13/logs/stdio qemux86-64-alt debian9-ty-2
https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2407/steps/13/logs/stdio ubuntu1804-ty-3 qemux86-64-alt Thu May 27 01:55:02 UTC 2021
https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2393/steps/13/logs/stdio qemux86-64-alt opensuse152-ty-1 Sun May 23 14:01:24 UTC 2021
https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2398/steps/13/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2413/steps/13/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2400/steps/13/logs/stdio
We ended up removing this test: http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=a939636ae4f117cee9663b3124df4b85cffffceb