<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>12789</bug_id>
          
          <creation_ts>2018-06-14 07:28:36 +0000</creation_ts>
          <short_desc>qa-tools: enhance script to analyze ptest log to identify test case that passing in precious cycle but failing in current cycle</short_desc>
          <delta_ts>2018-07-30 02:17:33 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Test Plans/Suite</product>
          <component>test-plans/suite</component>
          <version>2.4.3</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>High</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>2.6 M3</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="yeoh ee peng">ee.peng.yeoh</reporter>
          <assigned_to name="pankaj yadav">pankaj-y</assigned_to>
          <cc>pankaj-y</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>80785</commentid>
    <comment_count>0</comment_count>
    <who name="yeoh ee peng">ee.peng.yeoh</who>
    <bug_when>2018-06-14 07:28:36 +0000</bug_when>
    <thetext>Current qa-tools that was used to analyze ptest log focus on compiling overall % of passing, while this overall passing statistic was serving as a high level indicator, this does not pin point the real problem.  

Need to enhance qa-tools to identify specific test case where it was passing in previous QA release but failing on current QA release, so that this information will be used to open bugzilla ticket to investigate ptest failure.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>81024</commentid>
    <comment_count>1</comment_count>
    <who name="yeoh ee peng">ee.peng.yeoh</who>
    <bug_when>2018-07-06 01:56:19 +0000</bug_when>
    <thetext>I am working on this enhancement.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>81109</commentid>
    <comment_count>2</comment_count>
    <who name="pankaj yadav">pankaj-y</who>
    <bug_when>2018-07-13 07:37:44 +0000</bug_when>
    <thetext>I have identified the use cases and creating the script.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>81110</commentid>
    <comment_count>3</comment_count>
    <who name="yeoh ee peng">ee.peng.yeoh</who>
    <bug_when>2018-07-13 07:41:06 +0000</bug_when>
    <thetext>(In reply to comment #2)
&gt; I have identified the use cases and creating the script.

Perhaps you could change the Status: IN PROGRESS IMPLEMENTATION if you are already started the implementation.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>81138</commentid>
    <comment_count>4</comment_count>
    <who name="pankaj yadav">pankaj-y</who>
    <bug_when>2018-07-19 09:55:01 +0000</bug_when>
    <thetext>Script for comparison of Ptest result has been developed.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>81201</commentid>
    <comment_count>5</comment_count>
    <who name="pankaj yadav">pankaj-y</who>
    <bug_when>2018-07-30 02:17:33 +0000</bug_when>
    <thetext>Code implementation is done in qa-tools at below mentioned path :

http://git.yoctoproject.org/cgit/cgit.cgi/qa-tools/commit/?id=54071af421f91e34e84adafd435f18d686a0af8e</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>