Bug 15994

Summary: meta-oe-mirror: influxdb: dl.yp.org not updated after prefetching
Product: [Infrastructure] AutoBuilder Reporter: Yoann Congal <yoann.congal>
Component: autobuilderAssignee: Yoann Congal <yoann.congal>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: infras.ab.watcher, Infras.watcher, mhalstead, pidge, randy.macleod
Version: unspecified   
Target Milestone: 5.3 M4   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
log of a prefetch none

Description Yoann Congal 2025-10-09 23:32:01 UTC
Created attachment 5146 [details]
log of a prefetch

On AB, the meta-oe-mirror builder[0] repeatably fails on the influxdb recipe:
Despite a succeeded pre-fetching, one of the Go module listed in SRC_URI does not end up on https://downloads.yoctoproject.org/mirror/sources/.
The URL is "https://proxy.golang.org/github.com/benbjohnson/tmpl/%40v/v1.1.0.mod" which should end up as http://downloads.yoctoproject.org/mirror/sources/github.com.benbjohnson.tmpl%40v1.1.0.mod.

I can't reproduce locally. If I erase this file from my DL_DIR, it is recreated during the pre-fetch.

Mathieu provided me with log.do_fetch of the prefetch : the fact that this log is mostly empty let me believe that this file is, in fact in DL_DIR but not copied/synchronized with the web server at http://downloads.yoctoproject.org.

[0]: https://autobuilder.yoctoproject.org/valkyrie/#/builders/82/builds/469
Comment 1 Randy MacLeod 2025-10-16 14:37:45 UTC
Ask Halstead.
Comment 2 Yoann Congal 2025-10-16 14:39:28 UTC
Might be related to a "temporary fix" impacting temporary files matching "*tmp*" ?
Comment 3 Yoann Congal 2025-10-16 15:00:38 UTC
Mail sent to Halstead and helpdesk.
Comment 4 Michael Halstead 2025-10-23 18:26:51 UTC
We've updated the mirroring rule from 

/usr/local/bin/rsync -irlt --omit-dir-times --ignore-existing --delay-updates --copy-unsafe-links --exclude '**.lock'  --exclude '**.done'  --exclude '**\.nfs*'  --exclude '**\.tmp*' --exclude '**/tmp*' /mnt/tank/yocto/autobuilder/valkyrie.yocto.io/current_sources/ /mnt/tank/yocto/www/downloads.yoctoproject.org/mirror/sources/


to

/usr/local/bin/rsync -irlt --omit-dir-times --ignore-existing --delay-updates --copy-unsafe-links --exclude '**.lock'  --exclude '**.done'  --exclude '**\.nfs*'  --exclude '**\.tmp' --exclude '**/tmp*' /mnt/tank/yocto/autobuilder/valkyrie.yocto.io/current_sources/ /mnt/tank/yocto/www/downloads.yoctoproject.org/mirror/sources/

this file is now synced to mirror/sources. No other files were picked up by the change.
Comment 5 Yoann Congal 2025-10-24 06:39:24 UTC
With this, https://autobuilder.yoctoproject.org/valkyrie/#/builders/82/builds/487 is now green :⁠-⁠)