<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>15655</bug_id>
          
          <creation_ts>2024-11-20 23:20:42 +0000</creation_ts>
          <short_desc>reproducibility test does not display actual error log in case of build failure</short_desc>
          <delta_ts>2025-01-15 23:03:06 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Functional (self) Testing</product>
          <component>oe-selftest</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>5.2 M2</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Yoann Congal">yoann.congal</reporter>
          <assigned_to name="Yoann Congal">yoann.congal</assigned_to>
          <cc>randy.macleod</cc>
    
    <cc>richard.purdie</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>100226</commentid>
    <comment_count>0</comment_count>
    <who name="Yoann Congal">yoann.congal</who>
    <bug_when>2024-11-20 23:20:42 +0000</bug_when>
    <thetext>[0] reworked reproducibility test output in case of a build failure. But this new display may omit error messages which is hard to debug.

For example: https://valkyrie.yoctoproject.org/#/builders/37/builds/500/steps/12/logs/stdio
&gt; 2024-11-20 20:19:58,394 - oe-selftest - INFO -     NOTE: Tasks Summary: Attempted 21515 tasks of which 3874 didn&apos;t need to be rerun and all succeeded.
&gt; 2024-11-20 20:19:58,394 - oe-selftest - INFO -     
&gt; 2024-11-20 20:19:58,395 - oe-selftest - INFO -     Summary: There were 3 ERROR messages, returning a non-zero exit code.
The ERROR messages are not displayed.

In the full log [1]:
ERROR: tzcode-native-2024b-r0 do_populate_sysroot_setscene: Error executing a python function in exec_func_python() autogenerated:
WARNING: Logfile for failed setscene task is /srv/pokybuild/yocto-worker/reproducible/build/build-st/reproducibleB-extended/tmp/work/x86_64-linux/tzcode-native/2024b/temp/log.do_populate_sysroot_setscene.1543184
WARNING: Setscene task (/srv/pokybuild/yocto-worker/reproducible/build/meta/recipes-extended/timezone/tzcode-native.bb:do_populate_sysroot_setscene) failed with exit code &apos;1&apos; - real task will be run instead
ERROR: expect-native-5.45.4-r0 do_populate_sysroot_setscene: Error executing a python function in exec_func_python() autogenerated:
WARNING: Logfile for failed setscene task is /srv/pokybuild/yocto-worker/reproducible/build/build-st/reproducibleB-extended/tmp/work/x86_64-linux/expect-native/5.45.4/temp/log.do_populate_sysroot_setscene.1543937
WARNING: Setscene task (virtual:native:/srv/pokybuild/yocto-worker/reproducible/build/meta/recipes-devtools/expect/expect_5.45.4.bb:do_populate_sysroot_setscene) failed with exit code &apos;1&apos; - real task will be run instead
ERROR: python3-cryptography-native-43.0.1-r0 do_populate_sysroot_setscene: Error executing a python function in exec_func_python() autogenerated:
WARNING: Logfile for failed setscene task is /srv/pokybuild/yocto-worker/reproducible/build/build-st/reproducibleB-extended/tmp/work/x86_64-linux/python3-cryptography-native/43.0.1/temp/log.do_populate_sysroot_setscene.1549616
WARNING: Setscene task (virtual:native:/srv/pokybuild/yocto-worker/reproducible/build/meta/recipes-devtools/python/python3-cryptography_43.0.1.bb:do_populate_sysroot_setscene) failed with exit code &apos;1&apos; - real task will be run instead

setscene tasks failure (from an unrelated connection timeout issue) make bitbake return an error code but the task is not listed in failure since the &quot;real&quot;(not setscene) task succeeded.

[0]: https://git.yoctoproject.org/poky/commit/?id=5a9a5ad6a7bec5d07ed0d1efc0e62919498d5dbf
[1]: https://valkyrie.yocto.io/pub/repro-fail/oe-reproducible-20241120-5c59kuil/bitbake-reproducibleB-extended.log</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>100227</commentid>
    <comment_count>1</comment_count>
    <who name="Yoann Congal">yoann.congal</who>
    <bug_when>2024-11-20 23:24:58 +0000</bug_when>
    <thetext>(CC&apos;ing Richard since he reported it)

@Richard, any advice on how to handle this?
My first thought is to extract lines matching &quot;^ERROR:.*&quot; from logs and display those after the normal logs. Is that a good idea?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>100240</commentid>
    <comment_count>2</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2024-11-21 15:44:58 +0000</bug_when>
    <thetext>Yoann to add a message to point the full log.
Also dump the error with ~10 lines of context around the error.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>100658</commentid>
    <comment_count>3</comment_count>
    <who name="Yoann Congal">yoann.congal</who>
    <bug_when>2025-01-15 23:03:06 +0000</bug_when>
    <thetext>Fix merged:
selftest/reproducible: Print full log path on failure - openembedded-core - OpenEmbedded Core layer
https://git.openembedded.org/openembedded-core/commit/?id=1c2287849a2742445d80c81d6a1c6c3e3668765e
selftest/reproducible: Print error context on failure - openembedded-core - OpenEmbedded Core layer
https://git.openembedded.org/openembedded-core/commit/?id=b3bc820e58b65a976e0abce85fcdffd067697ecf</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>