Bug 12465

Summary: test case test_check_rpm_install_removal_log_file_size failed
Product: [QA/Testing] Runtime Testing Reporter: California Sullivan <california.l.sullivan>
Component: generalAssignee: Richard Purdie <richard.purdie>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: alexandre.belloni, anibal, jon.mason, randy.macleod, richard.purdie, stephano
Version: unspecified   
Target Milestone: 3.4 M1   
Hardware: x86   
OS: Multiple   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
trimmed
none
full log none

Description California Sullivan 2018-01-04 21:36:06 UTC 
Created attachment 4165 [details]
trimmed

The test installs and removes a package via RPM ten times, then checks /var/log/messages for lines containing "RPM", and asserts it is above 80. The test failed with the following:

| DEBUG: [Running]$ ssh -l root -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o LogLevel=ERROR 192.168.7.4 export PATH=/usr/sbin:/sbin:/usr/bin:/bin; grep RPM /var/log/messages | wc -l
| DEBUG: time: 1515073163.2173557, endtime: 1515073463.2118435
| DEBUG: Partial data from SSH call: 57
| 
| DEBUG: time: 1515073163.279065, endtime: 1515073463.279062
| DEBUG: [Command returned '0' after 0.07 seconds]
| DEBUG: Command: grep RPM /var/log/messages | wc -l
| Output:  57

Autobuilder link here: https://autobuilder.yocto.io/builders/nightly-x86/builds/702/steps/Running%20Sanity%20Tests/logs/stdio

Trimmed and full version of log attached.
Comment 1 California Sullivan 2018-01-04 21:36:27 UTC 
Created attachment 4166 [details]
full log
Comment 2 Richard Purdie 2018-01-04 22:19:26 UTC 
This test is pretty poor, we really need a better one which generates and tests for specific log messages. I suspect something else happened and was logged and this reduced the count. If the test fails, dumping the contents of the log would be very very useful too.
Comment 3 Richard Purdie 2018-01-11 15:36:25 UTC 
Also happened for https://autobuilder.yocto.io/builders/nightly-rpm-non-rpm/builds/682 so this is recurring
Comment 5 Jon Mason 2021-05-20 20:37:24 UTC 
Reocurrence in

https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2374/steps/13/logs/stdio
qemux86-64-alt 
debian9-ty-2
Comment 6 Alexandre Belloni 2021-05-27 15:17:23 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2407/steps/13/logs/stdio

ubuntu1804-ty-3
qemux86-64-alt

Thu May 27 01:55:02 UTC 2021
Comment 7 Alexandre Belloni 2021-05-27 23:07:27 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/109/builds/2393/steps/13/logs/stdio

qemux86-64-alt
opensuse152-ty-1

Sun May 23 14:01:24 UTC 2021
Comment 11 Richard Purdie 2021-06-24 14:42:53 UTC 
We ended up removing this test: http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=a939636ae4f117cee9663b3124df4b85cffffceb