Bug 16292 - AB-INT: Hung up HTTP connection while fetching on git.yp.org and git.oe.org
Summary: AB-INT: Hung up HTTP connection while fetching on git.yp.org and git.oe.org
Status: RESOLVED FIXED
Alias: None
Product: Infrastructure General
Classification: Infrastructure
Component: infrastructure-general (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 6.1 M1
Assignee: Michael Halstead
QA Contact:
URL:
Whiteboard: AB-INT
Depends on:
Blocks:
 
Reported: 2026-05-20 21:26 UTC by Yoann Congal
Modified: 2026-10-01 18:05 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Yoann Congal 2026-05-20 21:26:13 UTC
oe-selftest-debian debian12-vk-7 wrynose completed at 2026-05-19 20:17:48+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/3878
oe-selftest-fedora opensuse156-vk-1 wrynose completed at 2026-05-19 19:34:19+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/3740
oe-selftest-debian debian12-vk-2 wrynose completed at 2026-05-20 10:37:58+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/3884
oe-selftest-fedora fedora43-vk-1 wrynose completed at 2026-05-20 11:33:21+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/3746

It does not happened every time on the same test but each of those was cloning (via HTTP) a git.openembedded.org or git.yoctoproject.org repo.
And the HTTP connection appears to have been cut short before completion.

Example log:
Cloning into bare repository '/tmp/bitbake-fetch-q3nbzzi_/download/git2/git.openembedded.org.bitbake'...
remote: Enumerating objects: 70207, done.        
remote: Counting objects:   1% (1/74)        
[...]
remote: Counting objects: 100% (74/74), done.        
remote: Compressing objects:   2% (1/40)        
[...]
remote: Compressing objects: 100% (40/40), done.        
Receiving objects:   0% (1/70207)
Receiving objects:   1% (703/70207)
Receiving objects:   2% (1405/70207)
Receiving objects:   3% (2107/70207)
Receiving objects:   4% (2809/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:   5% (3511/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:   6% (4213/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:   7% (4915/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:   8% (5617/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:   9% (6319/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  10% (7021/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  11% (7723/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  12% (8425/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  13% (9127/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  14% (9829/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  15% (10532/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  16% (11234/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  17% (11936/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  18% (12638/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  19% (13340/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  20% (14042/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  21% (14744/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  22% (15446/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  23% (16148/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  24% (16850/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  25% (17552/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  26% (18254/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  27% (18956/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  28% (19658/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  29% (20361/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  30% (21063/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  31% (21765/70207), 936.00 KiB | 1.81 MiB/s
Receiving objects:  31% (22145/70207), 7.45 MiB | 7.22 MiB/s  
Receiving objects:  32% (22467/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  33% (23169/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  34% (23871/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  35% (24573/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  36% (25275/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  37% (25977/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  38% (26679/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  39% (27381/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  40% (28083/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  41% (28785/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  42% (29487/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  43% (30190/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  44% (30892/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  45% (31594/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  46% (32296/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  47% (32998/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  48% (33700/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  49% (34402/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  50% (35104/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  51% (35806/70207), 7.45 MiB | 7.22 MiB/s
Receiving objects:  52% (36508/70207), 7.45 MiB | 7.22 MiB/s
error: RPC failed; curl 56 Recv failure: Connection reset by peer
error: 55 bytes of body are still expected
fetch-pack: unexpected disconnect while reading sideband packet
fatal: early EOF
fatal: fetch-pack: invalid index-pack output
Failed to fetch URL git://git.openembedded.org/bitbake;branch=2.12;protocol=https;tag=2.12.0, attempting MIRRORS if available
Fetcher failure: Fetch command export PSEUDO_DISABLED=1; LANG=C git -c gc.autoDetach=false -c core.pager=cat -c safe.bareRepository=all -c clone.defaultRemoteName=origin clone --bare --mirror https://git.openembedded.org/bitbake /tmp/bitbake-fetch-q3nbzzi_/download/git2/git.openembedded.org.bitbake --progress failed with exit code 128, see logfile for output
Comment 1 Antonin Godard 2026-05-21 06:47:27 UTC
oe-selftest-fedora alma9-vk-2 agodard/master-next&agodard/master-next-bis completed at 2026-05-20 19:26:57+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/3749/steps/13/logs/stdio
Comment 2 Yoann Congal 2026-05-22 14:47:33 UTC
Forwarded message from Michael Halstead on Thu May 21, 2026 at 11:33 AM:
> Hi Yoann,
> 
> We conducted a deep dive into the Datadog reporting and Cloudflare
> analytics for the mirrors but found no obvious cause for the disconnects.
> Cloudflare's rules are correctly prioritizing all Valkyrie workers,
> ensuring they are not throttled, blocked, or subject to security rules.
> 
> We noticed a period where the Amsterdam mirror was unusually idle, though
> other logs did not indicate a specific issue.
> 
> One possibility is that browser integrity checking, which activates before
> our custom rules, is causing these issues. This has impacted AGL in the
> past, so we have now disabled integrity checking entirely. Let’s continue
> monitoring to see if this resolves the errors.
> 
> Thank you for the report and please ping in IRC if you catch this happening
> in real-time.
Comment 3 Michael Halstead 2026-10-01 18:05:12 UTC
Resolved by putting a local mirror into /etc/hosts.