<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>8180</bug_id>
          
          <creation_ts>2015-08-18 14:19:16 +0000</creation_ts>
          <short_desc>extensible SDK: silent error when using ipk packaging</short_desc>
          <delta_ts>2015-11-03 06:44:34 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>7</classification_id>
          <classification>Build System, Metadata &amp; Runtime</classification>
          <product>OE-Core</product>
          <component>devtools / tool chain</component>
          <version>1.8</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>VERIFIED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>1.9 M3</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Paul Eggleton">bluelightning</reporter>
          <assigned_to name="Benjamin Esquivel">benjamin.esquivel</assigned_to>
          <cc>bogdanx.a.voiculescu</cc>
    
    <cc>meta.mr.watcher</cc>
    
    <cc>meta.watcher</cc>
          
          <qa_contact name="Alexandru Georgescu">alexandru.c.georgescu</qa_contact>
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>53186</commentid>
    <comment_count>0</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2015-08-18 14:19:16 +0000</bug_when>
    <thetext>If you use ipk packaging and run bitbake core-image-minimal -c populate_sdk_ext and then look at log.do_populate_sdk_ext, you can see there are a couple of errors that don&apos;t cause the task to fail:

(&apos;movefile: Failed to move&apos;, &apos;/home/paul/poky/poky/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/var/lib/opkg/status&apos;, &apos;to&apos;, &apos;/home/paul/poky/poky/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/opt/poky/1.8+snapshot/sysroots/x86_64-pokysdk-linux/var/lib/opkg&apos;, OSError(21, &apos;Is a directory&apos;))
(&apos;movefile: Failed to move&apos;, &apos;/home/paul/poky/poky/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/var/lib/opkg/lists&apos;, &apos;to&apos;, &apos;/home/paul/poky/poky/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/opt/poky/1.8+snapshot/sysroots/x86_64-pokysdk-linux/var/lib/opkg&apos;, OSError(39, &apos;Directory not empty&apos;))

We&apos;re not checking the return of our calls to movefile() which is why the task doesn&apos;t fail. However, I&apos;m not entirely sure why we&apos;re even getting these errors in the first place. Ultimately we don&apos;t care about the opkg database in the SDK anyway but it would be worth investigating.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53280</commentid>
    <comment_count>1</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-20 16:46:10 +0000</bug_when>
    <thetext>I got this error reproduced:

(&apos;movefile: Failed to move&apos;, &apos;/home/besquive/poky-ipk/build/tmp/work/qemux86-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/var/lib/opkg/info&apos;, &apos;to&apos;, &apos;/home/besquive/poky-ipk/build/tmp/work/qemux86-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/opt/poky/1.8+snapshot/sysroots/x86_64-pokysdk-linux/var/lib/opkg&apos;, OSError(17, &apos;File exists&apos;))
(&apos;movefile: Failed to move&apos;, &apos;/home/besquive/poky-ipk/build/tmp/work/qemux86-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/var/lib/opkg/status&apos;, &apos;to&apos;, &apos;/home/besquive/poky-ipk/build/tmp/work/qemux86-poky-linux/core-image-minimal/1.0-r0/sdk-ext/image/opt/poky/1.8+snapshot/sysroots/x86_64-pokysdk-linux/var/lib/opkg&apos;, OSError(21, &apos;Is a directory&apos;))</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53294</commentid>
    <comment_count>2</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-20 19:50:56 +0000</bug_when>
    <thetext>It seems like meta/lib/oe/sdk.py, where movefile is invoked, checks for no return codes of anything it calls. At least it would be good to put some try checks around bb.utils.* calls (bb.utils.movefile is the object of this bug)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53297</commentid>
    <comment_count>3</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-20 20:15:31 +0000</bug_when>
    <thetext>sadly, the way that bb.utils.movefile deals with exceptions removes the ability to re-raise or let un-handled exceptions continue their own raise path. Will check the cost for having bb.utils.movefile let go exceptions. I bet this will be a fun test.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53298</commentid>
    <comment_count>4</comment_count>
      <attachid>2671</attachid>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-20 20:33:03 +0000</bug_when>
    <thetext>Created attachment 2671
python stack trace if the exception is raised

Attached a python stack trace that follows the path of the failure if the exception continues it&apos;s raise path.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53300</commentid>
    <comment_count>5</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-20 21:36:58 +0000</bug_when>
    <thetext>the movefile function in bb.utils is doing something like:

os.rename(path/to/file, new/path/)

and the os.rename function specifies in the manual:

&apos;...If dst is a directory, OSError will be raised.&apos;

which is the same error we&apos;re getting here.

I did a quick test to do instead:

os.rename(path/to/file, new/path/file)

and the errors are gone.

I&apos;m questioning whether this works for rpm/deb or if this is something ipk is doing wrong (pass of the src/dest paths to the movefile function)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53301</commentid>
    <comment_count>6</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-20 21:49:06 +0000</bug_when>
    <thetext>This error also happens in deb/rpm</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53302</commentid>
    <comment_count>7</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-20 22:04:58 +0000</bug_when>
    <thetext>a first approach to fix this:

http://lists.openembedded.org/pipermail/openembedded-core/2015-August/109117.html</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53335</commentid>
    <comment_count>8</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-21 18:12:18 +0000</bug_when>
    <thetext>A second and better approach to fix it:

http://lists.openembedded.org/pipermail/openembedded-core/2015-August/109190.html

now checks for the path join to do it to a dir, avoid doing it to a file name at the end which would be bogus</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53452</commentid>
    <comment_count>9</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-08-26 21:36:34 +0000</bug_when>
    <thetext>created a related bug:  the sdk.py script does not check for return codes

https://bugzilla.yoctoproject.org/show_bug.cgi?id=8213</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>53947</commentid>
    <comment_count>10</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2015-09-10 17:57:36 +0000</bug_when>
    <thetext>Now it shows up in master:

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=7c079463c96891f0dbf6d7744c0d6bfe7af1e0ca</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>56102</commentid>
    <comment_count>11</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2015-11-02 16:50:05 +0000</bug_when>
    <thetext>(In reply to comment #10)
&gt; Now it shows up in master:
&gt; 
&gt; http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/
&gt; ?id=7c079463c96891f0dbf6d7744c0d6bfe7af1e0ca

Verified with jethro:370a2916c4559c17952392b872322e8e490b124c

Steps:
1. modify conf/local.conf to use ipk packaging:

PACKAGE_CLASSES ?= &quot;package_ipk&quot;
added SSTATE_DIR and DL_DIR

2. build the sdk_ext: 

autobuilder@sstate1:~/tmp/poky/build-jethro-7629-sdk-ext$ bitbake core-image-minimal -c populate_sdk_ext


I will try again without using SSTATE_DIR / DL_DIR, than set it to verified.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>56112</commentid>
    <comment_count>12</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2015-11-03 06:44:34 +0000</bug_when>
    <thetext>(In reply to comment #11)
&gt; (In reply to comment #10)
&gt; &gt; Now it shows up in master:
&gt; &gt; 
&gt; &gt; http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/
&gt; &gt; ?id=7c079463c96891f0dbf6d7744c0d6bfe7af1e0ca
&gt; 
&gt; Verified with jethro:370a2916c4559c17952392b872322e8e490b124c
&gt; 
&gt; Steps:
&gt; 1. modify conf/local.conf to use ipk packaging:
&gt; 
&gt; PACKAGE_CLASSES ?= &quot;package_ipk&quot;
&gt; added SSTATE_DIR and DL_DIR
&gt; 
&gt; 2. build the sdk_ext: 
&gt; 
&gt; autobuilder@sstate1:~/tmp/poky/build-jethro-7629-sdk-ext$ bitbake
&gt; core-image-minimal -c populate_sdk_ext
&gt; 
&gt; 
&gt; I will try again without using SSTATE_DIR / DL_DIR, than set it to verified.

Verified without SSTATE_DIR and DL_DIR</thetext>
  </long_desc>
      
          <attachment
              isobsolete="0"
              ispatch="0"
              isprivate="0"
          >
            <attachid>2671</attachid>
            <date>2015-08-20 20:33:03 +0000</date>
            <delta_ts>2015-08-20 20:33:03 +0000</delta_ts>
            <desc>python stack trace if the exception is raised</desc>
            <filename>raise.txt</filename>
            <type>text/plain</type>
            <size>3482</size>
            <attacher name="Benjamin Esquivel">benjamin.esquivel</attacher>
            
              <data encoding="base64">REVCVUc6IFB5dGhvbiBmdW5jdGlvbiB3cml0ZV9ob3N0X3Nka19tYW5pZmVzdCBmaW5pc2hlZAoo
J21vdmVmaWxlOiBGYWlsZWQgdG8gbW92ZScsICcvaG9tZS9iZXNxdWl2ZS9wb2t5LWlway9idWls
ZC90bXAvd29yay9pNTg2LXBva3ktbGludXgvdW5pbmF0aXZlLXRhcmJhbGwvMS4wLXIwL3Nkay9p
bWFnZS92YXIvbGliL29wa2cvaW5mbycsICd0bycsICcvaG9tZS9iZXNxdWl2ZS9wb2t5LWlway9i
dWlsZC90bXAvd29yay9pNTg2LXBva3ktbGludXgvdW5pbmF0aXZlLXRhcmJhbGwvMS4wLXIwL3Nk
ay9pbWFnZS9vcHQvcG9reS8xLjgrc25hcHNob3Qvc3lzcm9vdHMveDg2XzY0LXBva3lzZGstbGlu
dXgvdmFyL2xpYi9vcGtnJywgT1NFcnJvcigxNywgJ0ZpbGUgZXhpc3RzJykpCkVSUk9SOiBFcnJv
ciBleGVjdXRpbmcgYSBweXRob24gZnVuY3Rpb24gaW4gL2hvbWUvYmVzcXVpdmUvcG9reS1pcGsv
bWV0YS9yZWNpcGVzLWNvcmUvbWV0YS91bmluYXRpdmUtdGFyYmFsbC5iYjoKClRoZSBzdGFjayB0
cmFjZSBvZiBweXRob24gY2FsbHMgdGhhdCByZXN1bHRlZCBpbiB0aGlzIGV4Y2VwdGlvbi9mYWls
dXJlIHdhczoKRmlsZTogJ2RvX3BvcHVsYXRlX3NkaycsIGxpbmVubzogMzUsIGZ1bmN0aW9uOiA8
bW9kdWxlPgogICAgIDAwMzE6ICAgIGlmIHNka19wYWNrYWdpbmdfZnVuYy5zdHJpcCgpOgogICAg
IDAwMzI6ICAgICAgICBiYi5idWlsZC5leGVjX2Z1bmMoZC5nZXRWYXIoIlNES19QQUNLQUdJTkdf
RlVOQyIsIFRydWUpLCBkKQogICAgIDAwMzM6CiAgICAgMDAzNDoKICoqKiAwMDM1OmRvX3BvcHVs
YXRlX3NkayhkKQogICAgIDAwMzY6CkZpbGU6ICdkb19wb3B1bGF0ZV9zZGsnLCBsaW5lbm86IDIz
LCBmdW5jdGlvbjogZG9fcG9wdWxhdGVfc2RrCiAgICAgMDAxOTogICAgICAgICAgICAgICAgICAg
IG1hbmlmZXN0X3R5cGU9TWFuaWZlc3QuTUFOSUZFU1RfVFlQRV9TREtfSE9TVCkKICAgICAwMDIw
OiAgICBjcmVhdGVfbWFuaWZlc3QoZCwgbWFuaWZlc3RfZGlyPWQuZ2V0VmFyKCdTREtfRElSJywg
VHJ1ZSksCiAgICAgMDAyMTogICAgICAgICAgICAgICAgICAgIG1hbmlmZXN0X3R5cGU9TWFuaWZl
c3QuTUFOSUZFU1RfVFlQRV9TREtfVEFSR0VUKQogICAgIDAwMjI6CiAqKiogMDAyMzogICAgcG9w
dWxhdGVfc2RrKGQpCiAgICAgMDAyNDoKICAgICAwMDI1OiAgICAjIFByb2Nlc3MgREVGQVVMVFRV
TkUKICAgICAwMDI2OiAgICBiYi5idWlsZC5leGVjX2Z1bmMoImNyZWF0ZV9zZGtfZmlsZXMiLCBk
KQogICAgIDAwMjc6CkZpbGU6ICcvaG9tZS9iZXNxdWl2ZS9wb2t5LWlway9tZXRhL2xpYi9vZS9z
ZGsucHknLCBsaW5lbm86IDMyMCwgZnVuY3Rpb246IHBvcHVsYXRlX3NkawogICAgIDAzMTY6ICAg
IGltZ190eXBlID0gZC5nZXRWYXIoJ0lNQUdFX1BLR1RZUEUnLCBUcnVlKQogICAgIDAzMTc6ICAg
IGlmIGltZ190eXBlID09ICJycG0iOgogICAgIDAzMTg6ICAgICAgICBScG1TZGsoZCwgbWFuaWZl
c3RfZGlyKS5wb3B1bGF0ZSgpCiAgICAgMDMxOTogICAgZWxpZiBpbWdfdHlwZSA9PSAiaXBrIjoK
ICoqKiAwMzIwOiAgICAgICAgT3BrZ1NkayhkLCBtYW5pZmVzdF9kaXIpLnBvcHVsYXRlKCkKICAg
ICAwMzIxOiAgICBlbGlmIGltZ190eXBlID09ICJkZWIiOgogICAgIDAzMjI6ICAgICAgICBEcGtn
U2RrKGQsIG1hbmlmZXN0X2RpcikucG9wdWxhdGUoKQogICAgIDAzMjM6CiAgICAgMDMyNDogICAg
b3MuZW52aXJvbi5jbGVhcigpCkZpbGU6ICcvaG9tZS9iZXNxdWl2ZS9wb2t5LWlway9tZXRhL2xp
Yi9vZS9zZGsucHknLCBsaW5lbm86IDQwLCBmdW5jdGlvbjogcG9wdWxhdGUKICAgICAwMDM2OiAg
ICBkZWYgcG9wdWxhdGUoc2VsZik6CiAgICAgMDAzNzogICAgICAgIGJiLnV0aWxzLm1rZGlyaGll
cihzZWxmLnNka19vdXRwdXQpCiAgICAgMDAzODoKICAgICAwMDM5OiAgICAgICAgIyBjYWxsIGJh
Y2tlbmQgZGVwZW5kZW50IGltcGxlbWVudGF0aW9uCiAqKiogMDA0MDogICAgICAgIHNlbGYuX3Bv
cHVsYXRlKCkKICAgICAwMDQxOgogICAgIDAwNDI6ICAgICAgICAjIERvbid0IHNoaXAgYW55IGxp
YkdMIGluIHRoZSBTREsKICAgICAwMDQzOiAgICAgICAgYmIudXRpbHMucmVtb3ZlKG9zLnBhdGgu
am9pbihzZWxmLnNka19vdXRwdXQsIHNlbGYuc2RrX25hdGl2ZV9wYXRoLAogICAgIDAwNDQ6ICAg
ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNlbGYuZC5nZXRWYXIoJ2xpYmRpcl9u
YXRpdmVzZGsnLCBUcnVlKS5zdHJpcCgnLycpLApGaWxlOiAnL2hvbWUvYmVzcXVpdmUvcG9reS1p
cGsvbWV0YS9saWIvb2Uvc2RrLnB5JywgbGluZW5vOiAyMjMsIGZ1bmN0aW9uOiBfcG9wdWxhdGUK
ICAgICAwMjE5OiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNl
bGYuZC5nZXRWYXIoJ2xvY2Fsc3RhdGVkaXJfbmF0aXZlc2RrJywgVHJ1ZSkuc3RyaXAoJy8nKSwK
ICAgICAwMjIwOiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJs
aWIiLCAib3BrZyIpCiAgICAgMDIyMTogICAgICAgIGJiLnV0aWxzLm1rZGlyaGllcihuYXRpdmVf
b3BrZ19zdGF0ZV9kaXIpCiAgICAgMDIyMjogICAgICAgIGZvciBmIGluIGdsb2IuZ2xvYihvcy5w
YXRoLmpvaW4oc2VsZi5zZGtfb3V0cHV0LCAidmFyIiwgImxpYiIsICJvcGtnIiwgIioiKSk6CiAq
KiogMDIyMzogICAgICAgICAgICBiYi51dGlscy5tb3ZlZmlsZShmLCBuYXRpdmVfb3BrZ19zdGF0
ZV9kaXIpCiAgICAgMDIyNDoKICAgICAwMjI1OiAgICAgICAgYmIudXRpbHMucmVtb3ZlKG9zLnBh
dGguam9pbihzZWxmLnNka19vdXRwdXQsICJ2YXIiKSwgVHJ1ZSkKICAgICAwMjI2OgogICAgIDAy
Mjc6CkZpbGU6ICcvaG9tZS9iZXNxdWl2ZS9wb2t5LWlway9iaXRiYWtlL2xpYi9iYi91dGlscy5w
eScsIGxpbmVubzogNzUwLCBmdW5jdGlvbjogbW92ZWZpbGUKICAgICAwNzQ2OiAgICAgICAgZXhj
ZXB0IEV4Y2VwdGlvbiBhcyBlOgogICAgIDA3NDc6ICAgICAgICAgICAgaWYgZVswXSAhPSBlcnJu
by5FWERFVjoKICAgICAwNzQ4OiAgICAgICAgICAgICAgICAjIFNvbWUgcmFuZG9tIGVycm9yLgog
ICAgIDA3NDk6ICAgICAgICAgICAgICAgIHByaW50KCJtb3ZlZmlsZTogRmFpbGVkIHRvIG1vdmUi
LCBzcmMsICJ0byIsIGRlc3QsIGUpCiAqKiogMDc1MDogICAgICAgICAgICByYWlzZSBlCiAgICAg
MDc1MTogICAgICAgICAgICAjIEludmFsaWQgY3Jvc3MtZGV2aWNlLWxpbmsgJ2JpbmQnIG1vdW50
ZWQgb3IgYWN0dWFsbHkgQ3Jvc3MtRGV2aWNlCiAgICAgMDc1MjoKICAgICAwNzUzOiAgICBpZiBy
ZW5hbWVmYWlsZWQ6CiAgICAgMDc1NDogICAgICAgIGRpZGNvcHkgPSAwCkV4Y2VwdGlvbjogT1NF
cnJvcjogW0Vycm5vIDE3XSBGaWxlIGV4aXN0cwoKREVCVUc6IFB5dGhvbiBmdW5jdGlvbiBkb19w
b3B1bGF0ZV9zZGsgZmluaXNoZWQKRVJST1I6IEZ1bmN0aW9uIGZhaWxlZDogZG9fcG9wdWxhdGVf
c2RrCgo=
</data>

          </attachment>
      

    </bug>

</bugzilla>