Bug 14933 - AB-INT PTEST: python3 test_storlines failure
Summary: AB-INT PTEST: python3 test_storlines failure
Status: RESOLVED FIXED
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium normal
Target Milestone: 4.3
Assignee: Trevor Gamblin
QA Contact:
URL:
Whiteboard: AB-INT
Depends on:
Blocks:
 
Reported: 2022-10-14 13:52 UTC by Alexandre Belloni
Modified: 2023-11-30 15:41 UTC (History)
4 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
log.do_testimage (1.15 MB, application/octet-stream)
2023-03-10 14:01 UTC, Alexandre Belloni
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandre Belloni 2022-10-14 13:52:46 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3817/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1

======================================================================
FAIL: test_storlines (test.test_ftplib.TestFTPClass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.10/test/test_ftplib.py", line 636, in test_storlines
    self.check_data(self.server.handler_instance.last_received_data, RETR_DATA)
  File "/usr/lib/python3.10/test/test_ftplib.py", line 507, in check_data
    self.assertEqual(len(received), len(expected))
AssertionError: 12019 != 12018

----------------------------------------------------------------------
Ran 94 tests in 7.818s

FAILED (failures=1, skipped=1)
Comment 1 Ross Burton 2022-10-20 12:45:58 UTC
The full log isn't much more useful:

FAIL: test_storlines (test.test_ftplib.TestFTPClass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.10/test/test_ftplib.py", line 636, in test_storlines
    self.check_data(self.server.handler_instance.last_received_data, RETR_DATA)
  File "/usr/lib/python3.10/test/test_ftplib.py", line 507, in check_data
    self.assertEqual(len(received), len(expected))
AssertionError: 12019 != 12018
Comment 2 Tim Orling 2022-10-20 14:49:15 UTC
This was master-next, so it was with the upgrade to 3.10.7:
https://lore.kernel.org/openembedded-core/20221012142204.3668465-1-tim.orling@konsulko.com/

We also saw the same failure on 'kirkstone' once for the 3.10.7 upgrade, so it is possible it is related to one of the commits in that point release. At the time we thought it was related to other breakage.

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3915/steps/12/logs/stdio
Comment 3 Tim Orling 2022-10-23 22:10:21 UTC
The kirkstone-nut failure is the same log (thanks to ross-tools/fetch-ptest-logsross-tools/fetch-ptest-logs)

======================================================================
FAIL: test_storlines (test.test_ftplib.TestFTPClass)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.10/test/test_ftplib.py", line 636, in test_storlines
    self.check_data(self.server.handler_instance.last_received_data, RETR_DATA)
  File "/usr/lib/python3.10/test/test_ftplib.py", line 507, in check_data
    self.assertEqual(len(received), len(expected))
AssertionError: 12019 != 12018

----------------------------------------------------------------------
Ran 94 tests in 7.958s

FAILED (failures=1, skipped=1)
test test_ftplib failed


Curiously, it is the same job/worker:
qemuarm64-ptest ubuntu2204-arm-1

The test case itself is rather mature, so it is not likely to be a change in the test: https://github.com/python/cpython/blame/3.10/Lib/test/test_ftplib.py#L632
Comment 4 Ross Burton 2022-10-24 19:06:08 UTC
Ran the tests here in qemuarm64 a few times, and it's not some 'just broken on aarch64' issue.
Comment 5 Alexandre Belloni 2022-11-02 20:19:05 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3968/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 6 Steve Sakoman 2022-12-13 23:15:02 UTC
kirkstone occurrence:

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/4192

qemuarm64-ptest ubuntu2204-arm-1
Comment 7 Alexandre Belloni 2022-12-22 14:25:07 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/4192/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 8 Alexandre Belloni 2023-03-10 14:01:54 UTC
Created attachment 4935 [details]
log.do_testimage
Comment 9 Randy MacLeod 2023-05-25 15:00:21 UTC
Likely fixed with python version upgrades.
Comment 10 Alexandre Belloni 2023-08-17 15:19:34 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5276/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 11 Alexandre Belloni 2023-09-21 17:07:53 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5531/steps/12/logs/stdio

qemux86-64-ptest debian11-ty-3