Bug 15088 - AB-INT: do_fetch unable to fetch local file
Summary: AB-INT: do_fetch unable to fetch local file
Status: RESOLVED FIXED
Alias: None
Product: BitBake
Classification: Build System, Metadata & Runtime
Component: bitbake (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 4.3 M2
Assignee: Unassigned
QA Contact:
URL:
Whiteboard: AB-INT AB-HAVE-PLAN
Depends on:
Blocks:
 
Reported: 2023-03-30 14:37 UTC by Alexandre Belloni
Modified: 2023-07-20 14:50 UTC (History)
6 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandre Belloni 2023-03-30 14:37:15 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/108/builds/4332/steps/11/logs/stdio

qemux86-world-alt ubuntu2204-ty-3

WARNING: lib32-busybox-1.36.0-r0 do_fetch: Failed to fetch URL file://0001-depmod-Ignore-.debug-directories.patch, attempting MIRRORS if available
ERROR: lib32-busybox-1.36.0-r0 do_fetch: Fetcher failure: Unable to find file file://0001-depmod-Ignore-.debug-directories.patch anywhere. The paths that were searched were:
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta-poky/recipes-core/busybox/busybox/poky-altcfg
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox-1.36.0/poky-altcfg
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox/poky-altcfg
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/files/poky-altcfg
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta-poky/recipes-core/busybox/busybox/poky
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox-1.36.0/poky
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox/poky
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/files/poky
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta-poky/recipes-core/busybox/busybox/qemux86-64
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox-1.36.0/qemux86-64
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox/qemux86-64
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/files/qemux86-64
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta-poky/recipes-core/busybox/busybox/qemuall
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox-1.36.0/qemuall
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox/qemuall
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/files/qemuall
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta-poky/recipes-core/busybox/busybox/x86
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox-1.36.0/x86
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox/x86
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/files/x86
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta-poky/recipes-core/busybox/busybox/i686
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox-1.36.0/i686
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox/i686
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/files/i686
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta-poky/recipes-core/busybox/busybox/
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox-1.36.0/
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/busybox/
    /home/pokybuild/yocto-worker/qemux86-world-alt/build/meta/recipes-core/busybox/files/
ERROR: lib32-busybox-1.36.0-r0 do_fetch: Bitbake Fetcher Error: FetchError('Unable to fetch URL from any source.', 'file://0001-depmod-Ignore-.debug-directories.patch')
Comment 1 Randy MacLeod 2023-03-30 14:55:29 UTC
Also seen in the WR autobuilder environment.
There is a patch added to make this more debugable if it happens again.
Comment 2 Richard Purdie 2023-03-30 14:55:57 UTC
Patch added to aid debugging if it fails again: https://git.yoctoproject.org/poky/commit/?id=c28a9a5799618ae1ddcccdd3a7f448d759e7a9a4
Comment 3 Randy MacLeod 2023-03-30 14:57:23 UTC
Randy to add more info from WR logs.
Comment 4 Randy MacLeod 2023-04-07 20:25:08 UTC
The WR autobuilder has seen this odd failure at least 3 times:

1. 2023-02-03, 20:40 ET fedora34_64 build container
   busybox_1.36.0 failed (do_patch) of 
      wrlinux-graphics_qemux86_sysvinit_world_predefined_cd.

      tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/recipe-sysroot-native

      Error link: http://ala-lpggp7.wrs.com:8090/Errors/Details/16713/

and then:
2. 2023-03-05, 07:10 ET wrlfull-lts21 build container
   busybox_1.36.0 failed (do_patch) of 
      nodistro_beaglebone-yocto_core-image-full-cmdline_cd.

      tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/

      Error link: http://ala-lpggp7.wrs.com:8090/Errors/Build/13586/

3. 2023-03-30, 18:50 ET  fedora37_64 build container
   busybox_1.36.0 failed (do_patch) of 
      nodistro_beaglebone-yocto_core-image-full-cmdline_cd., 18:50

      tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/recipe-sysroot-native

      Error link: http://ala-lpggp7.wrs.com:8090/Errors/Build/14330/

for 1.
log:
DEBUG: Executing python function extend_recipe_sysroot
NOTE: Direct dependencies are ['/home/wrlbuild/builds/builds-48fccb38-1ac0-489f-b81a-618397ea2b7c/layers/oe-core/meta/recipes-devtools/quilt/quilt-native_0.67.bb:do_populate_sysroot', 'virtual:native:/home/wrlbuild/builds/builds-48fccb38-1ac0-489f-b81a-618397ea2b7c/layers/oe-core/meta/recipes-devtools/patch/patch_2.7.6.bb:do_populate_sysroot']
NOTE: Installed into sysroot: ['quilt-native', 'patch-native', 'libtool-native', 'attr-native', 'texinfo-dummy-native', 'gettext-minimal-native']
NOTE: Skipping as already exists in sysroot: []
DEBUG: sed -e 's:^[^/]*/:TOPDIR/tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/recipe-sysroot-native/:g' TOPDIR/tmp-glibc/sysroots-components/x86_64/quilt-native/fixmepath TOPDIR/tmp-glibc/sysroots-components/x86_64/libtool-native/fixmepath | xargs sed -i -e 's:FIXMESTAGINGDIRTARGET:TOPDIR/tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/recipe-sysroot:g; s:FIXMESTAGINGDIRHOST:TOPDIR/tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/recipe-sysroot-native:g' -e 's:FIXME_PSEUDO_SYSROOT:TOPDIR/tmp-glibc/sysroots-components/x86_64/pseudo-native:g' -e 's:FIXME_HOSTTOOLS_DIR:TOPDIR/tmp-glibc/hosttools:g' -e 's:FIXME_PKGDATA_DIR:TOPDIR/tmp-glibc/pkgdata/beaglebone-yocto:g' -e 's:FIXME_PSEUDO_LOCALSTATEDIR:TOPDIR/tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/pseudo/:g' -e 's:FIXME_LOGFIFO:TOPDIR/tmp-glibc/work/cortexa8hf-neon-oe-linux-gnueabi/busybox/1.36.0-r0/temp/fifo.1092067:g'
DEBUG: Python function extend_recipe_sysroot finished
DEBUG: Executing python function do_patch
DEBUG: Executing python function patch_do_patch
NOTE: Applying patch '0001-depmod-Ignore-.debug-directories.patch' (../layers/oe-core/meta/recipes-core/busybox/files/0001-depmod-Ignore-.debug-directories.patch)
ERROR: Importing patch '0001-depmod-Ignore-.debug-directories.patch' with striplevel '1'
FileNotFoundError(2, 'No such file or directory')
DEBUG: Python function patch_do_patch finished
DEBUG: Python function do_patch finished



The problem is NOT seen in kirkstone-based or older builds.
Comment 5 Randy MacLeod 2023-04-07 20:36:31 UTC
Actually, there are two failure modes related to the file: 0001-depmod-Ignore-.debug-directories.patch - error on fetch and error on patch.

There are 9 do_fetch errors starting on 2023-02-01, 02:30  ET
and the most recent occurrence is on 2023-04-05, 02:20 ET



DEBUG: For url ['file', '', '0001-depmod-Ignore-.debug-directories.patch', '', '', OrderedDict()] comparing ['.*', '.*', '/.*', '', '', OrderedDict()] to ['file', '', '/home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/local/downloads/', '', '', OrderedDict()]
DEBUG: For url ['file', '', '0001-depmod-Ignore-.debug-directories.patch', '', '', OrderedDict()] comparing ['git', '.*', '/.*', '', '', OrderedDict()] to ['git', '', '/home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/local/git/BASENAME', '', '', OrderedDict([('protocol', 'file')])]
DEBUG: For url ['file', '', '0001-depmod-Ignore-.debug-directories.patch', '', '', OrderedDict()] comparing ['git', 'sourceware.org', '/git/glibc.git', '', '', OrderedDict()] to ['https', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', OrderedDict()]
DEBUG: For url ['file', '', '0001-depmod-Ignore-.debug-directories.patch', '', '', OrderedDict()] comparing ['git', 'sourceware.org', '/git/binutils-gdb.git', '', '', OrderedDict()] to ['https', 'downloads.yoctoproject.org', '/mirror/sources/', '', '', OrderedDict()]
DEBUG: Trying Upstream
WARNING: Failed to fetch URL file://0001-depmod-Ignore-.debug-directories.patch, attempting MIRRORS if available
DEBUG: Fetcher failure: Unable to find file file://0001-depmod-Ignore-.debug-directories.patch anywhere. The paths that were searched were:
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/meta-clang/recipes-core/busybox/busybox/nodistro
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox-1.36.0/nodistro
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox/nodistro
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/files/nodistro
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/meta-clang/recipes-core/busybox/busybox/ti-j72xx
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox-1.36.0/ti-j72xx
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox/ti-j72xx
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/files/ti-j72xx
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/meta-clang/recipes-core/busybox/busybox/armv8a
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox-1.36.0/armv8a
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox/armv8a
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/files/armv8a
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/meta-clang/recipes-core/busybox/busybox/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox-1.36.0/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/files/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/meta-clang/recipes-core/busybox/busybox/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox-1.36.0/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/files/aarch64
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/meta-clang/recipes-core/busybox/busybox/
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox-1.36.0/
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/busybox/
    /home/wrlbuild/builds/builds-b6910524-52cd-4f22-aa20-96b56217b0b5/layers/oe-core/meta/recipes-core/busybox/files/
Comment 6 Alexandre Belloni 2023-04-08 11:54:56 UTC
The second one is tracked as bug 15041
Comment 8 Randy MacLeod 2023-07-20 14:50:26 UTC
There was a rare corruption in the fetcher code that should have fixed this issue. Exact commit not known right now. -- YP Bug review