Bug 14933

Summary: AB-INT PTEST: python3 test_storlines failure
Product: [QA/Testing] Package Testing (ptest) Reporter: Alexandre Belloni <alexandre.belloni>
Component: ptestAssignee: Trevor Gamblin <tgamblin>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium CC: alexandre.belloni, randy.macleod, ross.burton, steve
Version: unspecified   
Target Milestone: 4.3   
Hardware: x86   
OS: Multiple   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
log.do_testimage none

Description Alexandre Belloni 2022-10-14 13:52:46 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3817/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1

======================================================================
FAIL: test_storlines (test.test_ftplib.TestFTPClass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.10/test/test_ftplib.py", line 636, in test_storlines
    self.check_data(self.server.handler_instance.last_received_data, RETR_DATA)
  File "/usr/lib/python3.10/test/test_ftplib.py", line 507, in check_data
    self.assertEqual(len(received), len(expected))
AssertionError: 12019 != 12018

----------------------------------------------------------------------
Ran 94 tests in 7.818s

FAILED (failures=1, skipped=1)
Comment 1 Ross Burton 2022-10-20 12:45:58 UTC
The full log isn't much more useful:

FAIL: test_storlines (test.test_ftplib.TestFTPClass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.10/test/test_ftplib.py", line 636, in test_storlines
    self.check_data(self.server.handler_instance.last_received_data, RETR_DATA)
  File "/usr/lib/python3.10/test/test_ftplib.py", line 507, in check_data
    self.assertEqual(len(received), len(expected))
AssertionError: 12019 != 12018
Comment 2 Tim Orling 2022-10-20 14:49:15 UTC
This was master-next, so it was with the upgrade to 3.10.7:
https://lore.kernel.org/openembedded-core/20221012142204.3668465-1-tim.orling@konsulko.com/

We also saw the same failure on 'kirkstone' once for the 3.10.7 upgrade, so it is possible it is related to one of the commits in that point release. At the time we thought it was related to other breakage.

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3915/steps/12/logs/stdio
Comment 3 Tim Orling 2022-10-23 22:10:21 UTC
The kirkstone-nut failure is the same log (thanks to ross-tools/fetch-ptest-logsross-tools/fetch-ptest-logs)

======================================================================
FAIL: test_storlines (test.test_ftplib.TestFTPClass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.10/test/test_ftplib.py", line 636, in test_storlines
    self.check_data(self.server.handler_instance.last_received_data, RETR_DATA)
  File "/usr/lib/python3.10/test/test_ftplib.py", line 507, in check_data
    self.assertEqual(len(received), len(expected))
AssertionError: 12019 != 12018

----------------------------------------------------------------------
Ran 94 tests in 7.958s

FAILED (failures=1, skipped=1)
test test_ftplib failed


Curiously, it is the same job/worker:
qemuarm64-ptest ubuntu2204-arm-1

The test case itself is rather mature, so it is not likely to be a change in the test: https://github.com/python/cpython/blame/3.10/Lib/test/test_ftplib.py#L632
Comment 4 Ross Burton 2022-10-24 19:06:08 UTC
Ran the tests here in qemuarm64 a few times, and it's not some 'just broken on aarch64' issue.
Comment 5 Alexandre Belloni 2022-11-02 20:19:05 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3968/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 6 Steve Sakoman 2022-12-13 23:15:02 UTC
kirkstone occurrence:

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/4192

qemuarm64-ptest ubuntu2204-arm-1
Comment 7 Alexandre Belloni 2022-12-22 14:25:07 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/4192/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 8 Alexandre Belloni 2023-03-10 14:01:54 UTC
Created attachment 4935 [details]
log.do_testimage
Comment 9 Randy MacLeod 2023-05-25 15:00:21 UTC
Likely fixed with python version upgrades.
Comment 10 Alexandre Belloni 2023-08-17 15:19:34 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5276/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 11 Alexandre Belloni 2023-09-21 17:07:53 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5531/steps/12/logs/stdio

qemux86-64-ptest debian11-ty-3