14469 2021-07-04 13:33:37 +0000 AB-INT PTEST: quilt faildiff.test ptest intermittent failure 2023-01-18 16:31:53 +0000 1 1 10 QA/Testing Package Testing (ptest) ptest 3.4 x86 Multiple RESOLVED FIXED AB-INT Medium normal 4.2 1 alexandre.belloni ross.burton alexandre.belloni chee.yang.lee randy.macleod richard.purdie ross.burton --- --- No (bug/feature does not impact docs) oldest_to_newest 90844 0 alexandre.belloni 2021-07-04 13:33:37 +0000 'quilt': ['faildiff.test'] https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2244/steps/12/logs/stdio qemux86-64-ptest centos8-ty-1 Note that this was with the update to glibc2.34 but wasn't seen on the other builds with the same update. 90976 1 alexandre.belloni 2021-07-22 12:44:30 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2291/steps/13/logs/stdio qemux86-64-ptest debian9-ty-2 91513 2 alexandre.belloni 2021-09-23 13:46:36 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/2274/steps/12/logs/stdio qemuarm64-ptest ubuntu2004-arm-1 91937 3 chee.yang.lee 2021-11-10 01:49:04 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2800/steps/12/logs/stdio ubuntu2004-ty-1 qemux86-64-ptest master-next 92895 4 randy.macleod 2022-03-31 14:45:42 +0000 This hasn't happened in ~4 months. 94689 5 alexandre.belloni 2023-01-12 15:06:37 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/93/builds/1522/steps/12/logs/stdio qemuarm64-ptest-fast ubuntu2004-arm-1 94701 6 richard.purdie 2023-01-12 15:45:47 +0000 https://autobuilder.yocto.io/pub/non-release/20230112-2/testresults/qemuarm64-ptest-fast/quilt.log 94707 7 alexandre.belloni 2023-01-12 16:07:54 +0000 [faildiff.test] [1] $ mkdir patches -- ok [3] $ quilt new test.diff -- ok [6] $ cat > test.txt -- ok [8] $ quilt add test.txt -- ok [13] $ chmod -r test.txt -- ok [15] $ quilt refresh -- ok [18] $ echo 1 -- ok [21] $ chmod +r test.txt -- ok [25] $ printf "\\002\\000\\001" > test.bin -- ok [26] $ quilt add test.bin -- ok [29] $ printf "\\003\\000\\001" > test.bin -- ok [30] $ quilt diff -pab --no-index -- failed Diff failed on file 'test.bin', aborting !~ (Files|Binary files) a/test\.bin and b/test\.bin differ Binary files a/test.bin and b/test.bin differ != Diff failed on file 'test.bin', aborting [33] $ echo 1 -- ok [36] $ quilt refresh -- ok [38] $ echo 1 -- ok 15 commands (14 passed, 1 failed) make: *** [Makefile:10: check-faildiff] Error 1 FAIL: faildiff.test 94708 8 alexandre.belloni 2023-01-12 16:18:58 +0000 I could actually reproduce this on our build server: $ quilt diff -pab --no-index Diff failed on file 'test.bin', aborting Binary files a/test.bin and b/test.bin differ whereas the test expects: Binary files a/test.bin and b/test.bin differ Diff failed on file 'test.bin', aborting 94713 9 alexandre.belloni 2023-01-12 19:43:36 +0000 The issue is that tests/run is merging stderr and stdout, one of the string is coming from stderr, the other on from stdout and it seems the order is not guaranteed. From a quick check, this seems to be the only test that is affected. 94718 10 ross.burton 2023-01-13 12:57:13 +0000 Filed https://savannah.nongnu.org/bugs/index.php?63651 upstream. A proper fix would involve writing perl <shudders> and changing test/run to not merge stdout/stderr and check them specifically. A hack would involve making both lines regex's and matching both strings in both lines... 94724 11 ross.burton 2023-01-13 16:57:29 +0000 Workaround hack on the list. 94725 12 ross.burton 2023-01-13 16:57:58 +0000 I'm assuming that all the failures are in faildiff.test line 30. All of the ones I've seen have been, but older logs have been purged. 94750 13 ross.burton 2023-01-18 16:31:53 +0000 Fixed in oe-core 1ddbe4d2bd8d8da10dac8a054f130fcd1d242219.