Bug 14655 - AB-INT: SDK preparation failure: SState: cannot test file://[...]
Summary: AB-INT: SDK preparation failure: SState: cannot test file://[...]
Status: RESOLVED WORKSFORME
Alias: None
Product: Runtime Testing
Classification: QA/Testing
Component: testsdk (show other bugs)
Version: 4.0
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 4.0 M4
Assignee: Michael Halstead
QA Contact:
URL:
Whiteboard: AB-INT-NET
Depends on:
Blocks:
 
Reported: 2021-12-11 15:11 UTC by Alexandre Belloni
Modified: 2025-02-14 16:48 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandre Belloni 2021-12-11 15:11:18 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/63/builds/4312/steps/17/logs/stdio
qemuppc debian9-ty-2

ERROR: SDK preparation failed: error log written to /home/pokybuild/yocto-worker/qemuppc/build/build/tmp/work/qemuppc-poky-linux/core-image-sato/1.0-r0/testsdkext/preparing_build_system.log

[...]

Preparing SDK for meta-extsdk-toolchain:do_populate_sysroot...
NOTE: Resolving any missing task queue dependencies
ERROR: SState: cannot test file://universal/ad/65/sstate:automake-native:x86_64-linux:1.16.3:r0:x86_64:7:ad659f90948c5755fd307aef97fee395c47e0ec6deb21f1dbe9988616bd8dc2a_populate_sysroot.tar.zst: 'GIT_SSL_CAINFO'
Sstate summary: Wanted 218 Local 92 Mirrors 125 Missed 1 Current 0 (99% match, 0% complete)
NOTE: Executing Tasks
Comment 1 Alexandre Belloni 2021-12-11 15:13:26 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/63/builds/4311/steps/17/logs/stdio
qemuppc ubuntu1604-ty-1

ERROR: SState: cannot test file://universal/09/12/sstate:popt-native:x86_64-linux:1.18:r0:x86_64:7:0912995cfce6659c1aa96f35ede5ebcf4f894699996072405271f055d95123f2_deploy_source_date_epoch.tar.zst: timed out
ERROR: SState: cannot test file://universal/6f/33/sstate:libmpc-native:x86_64-linux:1.2.1:r0:x86_64:7:6f334df4ab9451d5085bd89cefcb7e2739cf5fc13e8801204b016a815333e429_deploy_source_date_epoch.tar.zst: timed out
ERROR: SState: cannot test file://universal/86/38/sstate:xorgproto-native:x86_64-linux:2021.5:r0:x86_64:7:86388e472f412bd33fa11ff0bb7430f763eaa233e47c0592e4eb9a72712852ef_deploy_source_date_epoch.tar.zst: timed out
ERROR: SState: cannot test file://universal/d5/c7/sstate:qemu-helper-native:x86_64-linux:1.0:r1:x86_64:7:d5c788bd86643dce85cd8f971d05d513418bad0ce23b585184d3780136c84776_deploy_source_date_epoch.tar.zst: timed out
ERROR: SState: cannot test file://universal/ce/2b/sstate:gtk-doc-native:x86_64-linux:1.33.2:r0:x86_64:7:ce2b6a48f4888c0fd7ca9d7a5044e68998a194b38b8ca6d0221a1771ecd07bdd_deploy_source_date_epoch.tar.zst: timed out
ERROR: SState: cannot test file://universal/54/4e/sstate:ninja-native:x86_64-linux:1.10.2:r0:x86_64:7:544ee65f32a29cf2d949668e45a4a44ef0e3cf51f80bfb242c0e379057eb14fa_deploy_source_date_epoch.tar.zst: timed out
Comment 2 Alexandre Belloni 2021-12-11 15:17:09 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/42/builds/4318/steps/16/logs/stdio
qemuarm64 ubuntu1804-ty-1

ERROR: SState: cannot test file://universal/d5/07/sstate:xcb-proto-native:x86_64-linux:1.14.1:r0:x86_64:7:d5077074d42214bd840f49151e5bd15609e3d005406c0e0288b75c920aca7fc1_deploy_source_date_epoch.tar.zst: timed out
ERROR: SState: cannot test file://universal/0a/13/sstate:libcap-ng-native:x86_64-linux:0.8.2:r0:x86_64:7:0a138d4e4344dc7719ea52947fcf2c95cfafa1129616326d8bd0fe2e540d988d_deploy_source_date_epoch.tar.zst: timed out
ERROR: SState: cannot test file://universal/35/70/sstate:gperf-native:x86_64-linux:3.1:r0:x86_64:7:357081a799386d20019bb1a68753df6741834c7acad5ec4a1af9af4bcd012aff_deploy_source_date_epoch.tar.zst: timed out


https://autobuilder.yoctoproject.org/typhoon/#/builders/63/builds/4230/steps/15/logs/stdio
qemuppc debian11-ty-1

ERROR: SState: cannot test file://67/43/sstate:libgcc:ppc7400-poky-linux:11.2.0:r0:ppc7400:7:674397e5711b28684762c947d266365bef05b37dc50b0236107c289bfa0cc21b_deploy_source_date_epoch.tar.zst: 'GIT_SSL_CAINFO'
Comment 3 Jose Quaresma 2021-12-14 10:12:25 UTC 
Is not only the SDK, there are several sstate pieces missing when we do clean build.

# using the next configuration

cat <<EOF > build/conf/local.conf
SSTATE_MIRRORS = "file://.* http://sstate.yoctoproject.org/dev/PATH;downloadfilename=PATH"
BB_HASHSERVE_UPSTREAM = "typhoon.yocto.io:8687"

MACHINE ??= "qemux86-64"
DISTRO ??= "poky"
EOF

# dry-run to check the sstate

bitbake -n core-image-minimal

# about 50% of the sstate cache not found, and I get one time out connection

ERROR: SState: cannot test file://c2/3a/sstate:sqlite3:core2-64-poky-linux:3.37.0:r0:core2-64:7:c23a68dc2719ee338eb090fafc051b19652c13b38d21a3a78662a932b05d9e90_package.tar.zst: timed out
--
Sstate summary: Wanted 768 Local 0 Mirrors 366 Missed 402 Current 369 (47% match, 64% complete)

# this test is on master branch: git describe 
yocto-3.4-997-gc7c5fc879c
Comment 4 Alexandre Belloni 2021-12-23 20:47:03 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/73/builds/4414/steps/16/logs/stdio
qemux86-64 debian10-ty-1
Comment 12 Alexandre Belloni 2022-01-26 23:31:10 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/60/builds/4625/steps/16/logs/stdio
qemumips alma8-ty-2 has an SSD
Comment 15 Alexandre Belloni 2022-02-17 22:36:40 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/74/builds/4705/steps/17/logs/stdio
qemumips64 centos7-ty-4 non-SSD
Comment 16 Alexandre Belloni 2022-02-17 22:39:54 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/4751/steps/17/logs/stdio
qemuarm ubuntu1604-ty-1 non-SSD
Comment 17 Oleksiy Obitotskyy 2022-02-18 12:09:54 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/97/builds/4083/steps/16/logs/stdio
qemuarm64-armhost ubuntu2004-arm-1

ERROR: SState: cannot test file://universal/de/07/sstate:libmpc-native:aarch64-linux:1.2.1:r0:aarch64:8:de0756458cbae154fe6a52fea6be1714e9ed473ddc377225ab5e851aa8614a34_deploy_source_date_epoch.tar.zst: TimeoutError('timed out')
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/meta/classes/sstate.bbclass", line 1000, in checkstatus
    fetcher.checkstatus()
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1817, in checkstatus
    ret = m.try_mirrors(self, ud, self.d, mirrors, True)
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1590, in try_mirrors
    return bool(try_mirrors(fetch, d, urldata, mirrors, check))
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1116, in try_mirrors
    ret = try_mirror_url(fetch, origud, uds[index], ld, check)
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/__init__.py", line 1011, in try_mirror_url
    found = ud.method.checkstatus(fetch, ud, ld)
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/wget.py", line 369, in checkstatus
    with opener.open(r, timeout=30) as response:
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/aarch64-pokysdk-linux/usr/lib/python3.10/urllib/request.py", line 519, in open
    response = self._open(req, data)
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/aarch64-pokysdk-linux/usr/lib/python3.10/urllib/request.py", line 536, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/aarch64-pokysdk-linux/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/wget.py", line 166, in http_open
    return self.do_open(HTTPConnectionCache, req)
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/layers/build/bitbake/lib/bb/fetch2/wget.py", line 236, in do_open
    r = h.getresponse()
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/aarch64-pokysdk-linux/usr/lib/python3.10/http/client.py", line 1374, in getresponse
    response.begin()
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/aarch64-pokysdk-linux/usr/lib/python3.10/http/client.py", line 318, in begin
    version, status, reason = self._read_status()
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/aarch64-pokysdk-linux/usr/lib/python3.10/http/client.py", line 279, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/home/pokybuild/yocto-worker/qemuarm64-armhost/build/build/tmp/work/qemuarm64-poky-linux/core-image-sato/1.0-r0/testsdkext/buildtools/sysroots/aarch64-pokysdk-linux/usr/lib/python3.10/socket.py", line 705, in readinto
    return self._sock.recv_into(b)
TimeoutError: timed out

ERROR: SState: cannot test file://universal/b7/5c/sstate:gdb-cross-aarch64:aarch64-poky-linux:11.2:r0:aarch64_aarch64:8:b75cb0e25dff7646bbbe0932db036801a5d7ff49886a41edce4ec467505093e1_deploy_source_date_epoch.tar.zst: TimeoutError('timed out')
Traceback (most recent call last):
...
Comment 18 Oleksiy Obitotskyy 2022-02-19 20:09:39 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/60/builds/4732/steps/16/logs/stdio

qemumips ubuntu1804-ty-3 

ERROR: SState: cannot test file://universal/69/11/sstate:dtc-native:x86_64-linux:1.6.1:r0:x86_64:8:6911c491331878304e5674898aa10c571db37a461fc3d101bb27d235af0829a6_deploy_source_date_epoch.tar.zst: KeyError('GIT_SSL_CAINFO')
Comment 19 Alexandre Belloni 2022-03-17 14:00:32 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/4871/steps/17/logs/stdio

qemuarm ubuntu1604-ty-1
Comment 20 Randy MacLeod 2022-03-17 14:41:40 UTC 
This was a networking problem that has been resolved.
Comment 21 Randy MacLeod 2025-02-14 16:46:28 UTC 
bulk change to add Saul's non-WR address.
Comment 22 Randy MacLeod 2025-02-14 16:48:13 UTC 
Bulk change: Remove Saul's old WR address.