<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>15352</bug_id>
          
          <creation_ts>2024-01-17 10:14:37 +0000</creation_ts>
          <short_desc>AB-INT PTEST: gnutls naked-alerts test failure</short_desc>
          <delta_ts>2025-01-09 16:14:22 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Package Testing (ptest)</product>
          <component>ptest</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>WORKSFORME</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard>AB-INT</status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>5.2 M2</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="João Marcos Costa">joaomarcos.costa</reporter>
          <assigned_to name="Simone Weiß">simone.p.weiss</assigned_to>
          <cc>alexandre.belloni</cc>
    
    <cc>randy.macleod</cc>
    
    <cc>richard.purdie</cc>
    
    <cc>simone.p.weiss</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Don&apos;t know</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>97816</commentid>
    <comment_count>0</comment_count>
    <who name="João Marcos Costa">joaomarcos.costa</who>
    <bug_when>2024-01-17 10:14:37 +0000</bug_when>
    <thetext>WARNING: core-image-ptest-gnutls-1.0-r0 do_testimage: There were failing ptests.
Traceback (most recent call last):
  File &quot;/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py&quot;, line 35, in wrapped_f
    return func(*args, **kwargs)
  File &quot;/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py&quot;, line 35, in wrapped_f
    return func(*args, **kwargs)
  File &quot;/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py&quot;, line 35, in wrapped_f
    return func(*args, **kwargs)
  File &quot;/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py&quot;, line 27, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File &quot;/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py&quot;, line 120, in do_ptestrunner
    self.fail(failmsg)
AssertionError: 
Failed ptests:
{&apos;gnutls&apos;: [&apos;naked-alerts&apos;]}

https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5925/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>97852</commentid>
    <comment_count>1</comment_count>
    <who name="João Marcos Costa">joaomarcos.costa</who>
    <bug_when>2024-01-17 14:05:40 +0000</bug_when>
    <thetext>https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5776/steps/12/logs/stdio

qemux86-64-ptest debian11-ty-1</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>97880</commentid>
    <comment_count>2</comment_count>
    <who name="João Marcos Costa">joaomarcos.costa</who>
    <bug_when>2024-01-17 16:08:46 +0000</bug_when>
    <thetext>https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/6076/steps/13/logs/stdio

qemux86-64-ptest opensuse154-ty-3</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>98100</commentid>
    <comment_count>3</comment_count>
    <who name="Simone Weiß">simone.p.weiss</who>
    <bug_when>2024-02-01 18:09:12 +0000</bug_when>
    <thetext>Tried to reproduce it within qemux86-64 ptest-image and just with make check based upon gnutls sources. No luck so far.

Is there any way to obtain this log https://git.yoctoproject.org/poky/tree/meta/recipes-support/gnutls/gnutls/run-ptest#n56 from the autobuilder upon failure? That might help to understand why it fails</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>98115</commentid>
    <comment_count>4</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2024-02-01 21:48:49 +0000</bug_when>
    <thetext>Simone, 

Yes that should be possible but we don&apos;t want to gather too much data.
I don&apos;t think there&apos;s a ptest example to copy but I could be wrong...

Can you dive into:
   https://git.yoctoproject.org/yocto-autobuilder-helper/log/?qt=grep&amp;q=collect
and see what you can figure out. I did some work with Sakib Sajal and Aryaman Gupta 
a while ago on collecting host data to help understand the intermittent build failures that we 
were seeing so I might be able to help out if needed. 

The data could be available via:

   https://autobuilder.yocto.io/pub/non-release/

for example see this intermittent build failure log:

   https://autobuilder.yocto.io/pub/non-release/20240201-30/testresults/qemuarm64-ptest/intermittent_failure_host_data/host_stats_interval_2_top_summary.txt

which is part of this larger run:
   https://autobuilder.yocto.io/pub/non-release/20240201-30/testresults/

We also sample the buildhistory logs using: 
   https://git.yoctoproject.org/yocto-autobuilder-helper/tree/scripts/archive_buildstats.py
so maybe that will help.

If all of this is too much to grok, just ask on the yocto list or irc or ask me to invite you to a YP Autobuilder discussion call (Thursday&apos;s 9 AM ET).</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>98116</commentid>
    <comment_count>5</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2024-02-01 23:08:38 +0000</bug_when>
    <thetext>Simone, 
Alex Belloni tells me that:
   &quot;This&quot; is the goal of our high bug.: 
      https://bugzilla.yoctoproject.org/show_bug.cgi?id=14901
   We would be able to configure per recipe which log we want to lift out of the host or guest on test failure</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>98129</commentid>
    <comment_count>6</comment_count>
    <who name="Simone Weiß">simone.p.weiss</who>
    <bug_when>2024-02-05 15:17:06 +0000</bug_when>
    <thetext>ThX Randy, I will see what I can work out</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>99020</commentid>
    <comment_count>7</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2024-05-16 14:56:30 +0000</bug_when>
    <thetext>Simone, bumped to 5.1-M2. Hopefully you&apos;ll make/find time to work on this bug.
Thanks,
Randy for the YP bug review</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>99342</commentid>
    <comment_count>8</comment_count>
    <who name="João Marcos Costa">joaomarcos.costa</who>
    <bug_when>2024-07-10 10:17:56 +0000</bug_when>
    <thetext>https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6600/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>99440</commentid>
    <comment_count>9</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2024-07-25 14:53:11 +0000</bug_when>
    <thetext>Any news Simone?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>100584</commentid>
    <comment_count>10</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2025-01-09 16:14:22 +0000</bug_when>
    <thetext>Not seen in a while and only happened once on the slow arm builder.
Better logging would be useful but resolving anyway...</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>