Bug 14775 - AB-INT: SDK preparation failure: SState: cannot test file://[...] TimeoutError('timed out')
Summary: AB-INT: SDK preparation failure: SState: cannot test file://[...] TimeoutErro...
Status: RESOLVED WORKSFORME
Alias: None
Product: Runtime Testing
Classification: QA/Testing
Component: testsdk (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 4.2 M2
Assignee: Unassigned
QA Contact:
URL:
Whiteboard: AB-INT AB-SSD AB-FREQUENT
: 14684 (view as bug list)
Depends on:
Blocks:
 
Reported: 2022-04-06 09:36 UTC by Alexandre Belloni
Modified: 2023-02-02 15:56 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
Akustrer builder SSTATE timeout log (4.96 KB, text/plain)
2022-06-23 14:05 UTC, akuster
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandre Belloni 2022-04-06 09:36:01 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/73/builds/4926/steps/15/logs/stdio

qemux86-64 alma8-ty-2


ERROR: SState: cannot test file://universal/69/11/sstate:dtc-native:x86_64-linux:1.6.1:r0:x86_64:8:6911c491331878304e5674898aa10c571db37a461fc3d101bb27d235af0829a6_deploy_source_date_epoch.tar.zst: TimeoutError('timed out')
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/meta/classes/sstate.bbclass", line 999, in checkstatus
    fetcher.checkstatus()
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1828, in checkstatus
    ret = m.try_mirrors(self, ud, self.d, mirrors, True)
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1601, in try_mirrors
    return bool(try_mirrors(fetch, d, urldata, mirrors, check))
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1127, in try_mirrors
    ret = try_mirror_url(fetch, origud, uds[index], ld, check)
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1022, in try_mirror_url
    found = ud.method.checkstatus(fetch, ud, ld)
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/wget.py", line 361, in checkstatus
    with opener.open(r, timeout=30) as response:
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.10/urllib/request.py", line 519, in open
    response = self._open(req, data)
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.10/urllib/request.py", line 536, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/wget.py", line 166, in http_open
    return self.do_open(HTTPConnectionCache, req)
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/wget.py", line 236, in do_open
    r = h.getresponse()
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.10/http/client.py", line 1374, in getresponse
    response.begin()
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.10/http/client.py", line 318, in begin
    version, status, reason = self._read_status()
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.10/http/client.py", line 279, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/pokybuild/yocto-worker/qemux86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/x86_64-pokysdk-linux/usr/lib/python3.10/socket.py", line 705, in readinto
    return self._sock.recv_into(b)
TimeoutError: timed out
Comment 1 Alexandre Belloni 2022-04-11 10:10:51 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/4372/steps/16/logs/stdio

qemuarm64-armhost ubuntu2004-arm-1
Comment 2 Alexandre Belloni 2022-04-13 06:14:17 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/79/builds/3430/steps/14/logs/stdio

oe-selftest-centos centos8-ty-1
Comment 3 Alexandre Belloni 2022-04-13 06:15:42 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/79/builds/3431/steps/14/logs/stdio

oe-selftest-centos stream8-ty-1
Comment 4 Alexandre Belloni 2022-04-14 14:01:13 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/74/builds/5007/steps/15/logs/stdio

qemumips64 fedora35-ty-2 has an SSD
Comment 5 Randy MacLeod 2022-04-14 15:22:02 UTC
We should write a stress test case for this and halstead could run it in an isolated controlled environment.
Comment 6 Richard Purdie 2022-04-16 10:18:40 UTC
*** Bug 14684 has been marked as a duplicate of this bug. ***
Comment 7 Alexandre Belloni 2022-05-19 11:11:52 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/74/builds/5083/steps/16/logs/stdio

qemumips64 tumbleweed-ty-3
Comment 8 Steve Sakoman 2022-05-25 18:34:08 UTC
kirkstone, oe-selftest-fedora, fedora35-ty-1

https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/3592
Comment 9 Alexandre Belloni 2022-06-02 11:32:22 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/74/builds/5168/steps/16/logs/stdio

qemumips64 ubuntu1804-ty-3
Comment 10 Alexandre Belloni 2022-06-02 12:10:58 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/4511/steps/16/logs/stdio
qemuarm64-armhost ubuntu1804-arm-1
Comment 11 Steve Sakoman 2022-06-06 16:47:54 UTC
kirkstone, qemuarm64-armhost, ubuntu1804-arm-1

https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/4658
Comment 12 Steve Sakoman 2022-06-06 16:49:05 UTC
(In reply to comment #11)
> kirkstone, qemuarm64-armhost, ubuntu1804-arm-1

Sorry, it was dunfell, not kirkstone!

> 
> https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/4658
Comment 13 Steve Sakoman 2022-06-06 18:48:16 UTC
dunfell, qemuarm, ubuntu1804-ty-3

https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/5324
Comment 15 akuster 2022-06-23 01:31:08 UTC
Seeing this on my build system on an Ubuntu 20.04 system.

https://gitlab.com/akuster/meta-security/-/jobs/2625596915

hope you can see the logs.
Comment 16 akuster 2022-06-23 14:05:01 UTC
Created attachment 4885 [details]
Akustrer builder SSTATE timeout log
Comment 17 Randy MacLeod 2022-06-23 14:46:42 UTC
Changes made the NAS tunings.
Armin, bug releated to the rate-limited public facing behaviour should be handled in another bug, please.
Comment 19 Steve Sakoman 2022-07-07 16:20:15 UTC
kirkstone

https://autobuilder.yoctoproject.org/typhoon/#/builders/59/builds/5422

qemux86 centos7-ty-4
Comment 20 Alexandre Belloni 2022-08-12 09:08:29 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/63/builds/5556/steps/17/logs/stdio

qemuppc opensuse153-ty-1
Comment 21 Alexandre Belloni 2022-08-16 18:55:29 UTC
https://autobuilder.yoctoproject.org/typhoon/#builders/97/builds/5056/steps/16/logs/stdio

qemuarm64-armhost ubuntu1804-arm-1
Comment 23 Randy MacLeod 2023-02-02 15:56:19 UTC
Hasn't been seen in 2 months. Re-open if seen again.