<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>10649</bug_id>
          
          <creation_ts>2016-11-11 17:57:21 +0000</creation_ts>
          <short_desc>devtool: output from recipetool breaks &apos;add&apos; for some remote sources</short_desc>
          <delta_ts>2017-01-04 16:23:46 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>7</classification_id>
          <classification>Build System, Metadata &amp; Runtime</classification>
          <product>OE-Core</product>
          <component>Scripts and Tools</component>
          <version>2.2</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>VERIFIED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>High</priority>
          <bug_severity>major</bug_severity>
          <target_milestone>2.3 M1</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Stephano Cetola">stephano</reporter>
          <assigned_to name="Stephano Cetola">stephano</assigned_to>
          <cc>bluelightning</cc>
    
    <cc>jose.perez.carranza</cc>
    
    <cc>ross.burton</cc>
          
          <qa_contact name="Juan Ramos">juan.fernandox.ramos.frayle</qa_contact>
          <cf_os>---</cf_os>
          <cf_regression_type>Regression (Used to work)</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>68260</commentid>
    <comment_count>0</comment_count>
    <who name="Stephano Cetola">stephano</who>
    <bug_when>2016-11-11 17:57:21 +0000</bug_when>
    <thetext>Introduced in 452a1133ddadfb0750e930843d0e284185fca17c

Since adding the &quot;watch=True&quot; to exec_build_env_command, devtool add is now throwing a UnicodeDecodeError for all remote sources which cause fetcher to use wget (tarballs, binary packages, etc).

The exception is thrown here: devtool/__init__.py: 73    out = out.decode(&apos;utf-8&apos;)

devtool is outputting characters like these [â]:
HTTP request sent, awaiting response... 200 OK
Length: 164035 (160K) [application/x-bzip2]
Saving to: â/poky_sdk/downloads/xclock-1.0.7.tar.bz2â

I believe that these âs are UTF-8 quotes (U+2018 and 2019) that are unable to display properly. My terminal is setup to display UTF-8 properly, and does so if I run wget directly.

I&apos;ve reproduced this on multiple machines, including one Debian VM with a very minimal setup, by simply running:


devtool add http://ftp.x.org/pub/individual/app/xclock-1.0.7.tar.bz2


exec_build_env_command sources oe-init-build-env and then runs (in this case a call to recipetool) through the script command so that bitbake will think it is outputting to a terminal. Something may be getting lost here.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>68411</commentid>
    <comment_count>1</comment_count>
    <who name="Stephano Cetola">stephano</who>
    <bug_when>2016-11-17 16:03:50 +0000</bug_when>
    <thetext>A fix was submitted for this from iajie.hu@intel.com.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>68413</commentid>
    <comment_count>2</comment_count>
    <who name="Stephano Cetola">stephano</who>
    <bug_when>2016-11-17 16:04:45 +0000</bug_when>
    <thetext>That should be jiajie.hu@intel.com</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>68546</commentid>
    <comment_count>3</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2016-11-23 19:45:39 +0000</bug_when>
    <thetext>Fix merged to master:

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=bfd8c35c3f917e3806c8dfe36c98c70fbccbb3c9</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>69480</commentid>
    <comment_count>4</comment_count>
    <who name="Juan Ramos">juan.fernandox.ramos.frayle</who>
    <bug_when>2017-01-04 16:23:46 +0000</bug_when>
    <thetext>this issue is not present in commit dbb247cac5fbf7b037e4955f9793828451723924, verified</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>