<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>14441</bug_id>
          
          <creation_ts>2021-06-17 14:01:12 +0000</creation_ts>
          <short_desc>possible DL_DIR cloning race condition</short_desc>
          <delta_ts>2021-10-28 14:58:13 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>7</classification_id>
          <classification>Build System, Metadata &amp; Runtime</classification>
          <product>BitBake</product>
          <component>bitbake</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard>AB-INT AB-INT-TMPFS</status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>3.4 M4</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Alexandre Belloni">alexandre.belloni</reporter>
          <assigned_to name="Richard Purdie">richard.purdie</assigned_to>
          <cc>poky.bs.watcher</cc>
    
    <cc>poky.watcher</cc>
    
    <cc>randy.macleod</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>90670</commentid>
    <comment_count>0</comment_count>
    <who name="Alexandre Belloni">alexandre.belloni</who>
    <bug_when>2021-06-17 14:01:12 +0000</bug_when>
    <thetext>https://autobuilder.yoctoproject.org/typhoon/#/builders/23/builds/3797/steps/13/logs/stdio

ERROR: linux-yocto-5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0 do_unpack: Fetcher failure: Fetch command export PSEUDO_DISABLED=1; export ftp_proxy=&quot;http://proxy.yocto.io:5187/&quot;; export FTP_PROXY=&quot;http://proxy.yocto.io:5187/&quot;; export PATH=&quot;/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/sysroots-uninative/x86_64-linux/usr/bin:/home/pokybuild/yocto-worker/build-appliance/build/scripts:/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/recipe-sysroot-native/usr/bin/x86_64-poky-linux:/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/recipe-sysroot/usr/bin/crossscripts:/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/recipe-sysroot-native/usr/sbin:/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/recipe-sysroot-native/usr/bin:/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/recipe-sysroot-native/sbin:/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/recipe-sysroot-native/bin:/home/pokybuild/yocto-worker/build-appliance/build/bitbake/bin:/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/hosttools&quot;; export HOME=&quot;/home/pokybuild&quot;; git -c core.fsyncobjectfiles=0 clone -n -s /home/pokybuild/yocto-worker/build-appliance/build/build/downloads/git2/git.yoctoproject.org.linux-yocto.git/ /home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/git/ failed with exit code 128, output:
Cloning into &apos;/home/pokybuild/yocto-worker/build-appliance/build/build/tmp/work/qemux86_64-poky-linux/linux-yocto/5.10.41+gitAUTOINC+48a13749dc_33069919e2-r0/git&apos;...
error: refs/heads/master does not point to a valid object!
error: refs/heads/master-4.19 does not point to a valid object!
error: refs/heads/v4.14/base does not point to a valid object!
error: refs/heads/v4.15/standard/arm-versatile-926ejs does not point to a valid object!
error: refs/heads/v4.15/standard/base does not point to a valid object!</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>90683</commentid>
    <comment_count>1</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2021-06-17 14:52:48 +0000</bug_when>
    <thetext>Audit the nfs locking.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>90879</commentid>
    <comment_count>2</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2021-07-07 12:19:37 +0000</bug_when>
    <thetext>It can&apos;t be NFS since build-appliance does local fetches and the paths in question are local to the build directory. It will not reference git repos via the file:// urls either.

To result in corruption like this I&apos;m wondering if there was a race over creation of the mirror tarballs and a truncated mirror tarball was accessed.

The creation of the git mirror tarballs in git.py uses tar directly on the file and could mv the file into position after creation to avoid races.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>91445</commentid>
    <comment_count>3</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2021-09-16 14:26:16 +0000</bug_when>
    <thetext>I plan to fix the mirror tarball race and then see if this recurs</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>91475</commentid>
    <comment_count>4</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2021-09-20 15:36:26 +0000</bug_when>
    <thetext>Fix in http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=626e949292a4d21cc828fcc6c8d5f62a93622f61 and we can reopen or file a new bug if the issue recurs.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>91842</commentid>
    <comment_count>5</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2021-10-28 14:58:13 +0000</bug_when>
    <thetext>*** Bug 14516 has been marked as a duplicate of this bug. ***</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>