<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>11583</bug_id>
          
          <creation_ts>2017-05-25 20:53:56 +0000</creation_ts>
          <short_desc>oeqa: core add support to publish results</short_desc>
          <delta_ts>2019-01-10 16:03:36 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Runtime Testing</product>
          <component>general</component>
          <version>2.3</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>2.7 M1</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Aníbal Limón">anibal.limon</reporter>
          <assigned_to name="yeoh ee peng">ee.peng.yeoh</assigned_to>
          <cc>akuster</cc>
    
    <cc>ee.peng.yeoh</cc>
    
    <cc>joshuagloe</cc>
    
    <cc>juan.m.cruz.alcaraz</cc>
    
    <cc>leonardo.sandoval.gonzalez</cc>
    
    <cc>markus.lehtonen</cc>
    
    <cc>richard.purdie</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>73518</commentid>
    <comment_count>0</comment_count>
    <who name="Aníbal Limón">anibal.limon</who>
    <bug_when>2017-05-25 20:53:56 +0000</bug_when>
    <thetext>At this time oe-selftest has a functionality to publish test results into a git respository but isn&apos;t on use.

The implementation needs to be in OEQA core to share the functionality across Test components.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>75152</commentid>
    <comment_count>1</comment_count>
    <who name="Aníbal Limón">anibal.limon</who>
    <bug_when>2017-07-19 19:41:39 +0000</bug_when>
    <thetext>This is an old discussion, the oeqa framework needs to handle it? or the AutoBuilder when the results log comes?.

The oe-git-archive already has this functionality currently used by build performance tests.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>75185</commentid>
    <comment_count>2</comment_count>
    <who name="Joshua Lock">joshuagloe</who>
    <bug_when>2017-07-20 12:56:52 +0000</bug_when>
    <thetext>This functionality should live in oe-core, we want to have less logic in the autobuilder where possible.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>79522</commentid>
    <comment_count>3</comment_count>
    <who name="Markus Lehtonen">markus.lehtonen</who>
    <bug_when>2018-02-21 07:45:16 +0000</bug_when>
    <thetext>As scripts/oe-git-archive handles committing test results to git and pushing them upstream, this should be simple to implement as an autobuilder step. Virtually a one-liner running oe-git-archive (with the desired options)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>79742</commentid>
    <comment_count>4</comment_count>
    <who name="Apoorv">apoorv.sangal</who>
    <bug_when>2018-03-07 19:15:05 +0000</bug_when>
    <thetext>QA team is in process of creating a structure to store results and logs. Moving this to 2.6.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>81580</commentid>
    <comment_count>5</comment_count>
    <who name="yeoh ee peng">ee.peng.yeoh</who>
    <bug_when>2018-09-20 06:06:00 +0000</bug_when>
    <thetext>In order to allow easy consumption/analysis of the published testresult by future reporting tools, the published testresult need to have standard format and structure. 

Propose to enable oeqa to output testresult grouped by each module into separate json files with predefined structure (testsuite - testcase). 

Submitted the patch to openembedded-core mailing list. 
http://lists.openembedded.org/pipermail/openembedded-core/2018-September/155856.html
http://lists.openembedded.org/pipermail/openembedded-core/2018-September/155855.html</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>82732</commentid>
    <comment_count>6</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2019-01-10 16:03:36 +0000</bug_when>
    <thetext>The autobuilder now generates testresults.json files.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>