<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>9559</bug_id>
          
          <creation_ts>2016-04-29 17:15:24 +0000</creation_ts>
          <short_desc>test reporting tool plan</short_desc>
          <delta_ts>2016-07-29 14:43:56 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Test Plans/Suite</product>
          <component>test-plans/suite</component>
          <version>2.2</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>VERIFIED</bug_status>
          <resolution>FIXED</resolution>
          
          <see_also>https://bugzilla.yoctoproject.org/show_bug.cgi?id=9954</see_also>
    
    <see_also>https://bugzilla.yoctoproject.org/show_bug.cgi?id=9956</see_also>
    
    <see_also>https://bugzilla.yoctoproject.org/show_bug.cgi?id=9957</see_also>
    
    <see_also>https://bugzilla.yoctoproject.org/show_bug.cgi?id=9958</see_also>
          <bug_file_loc>https://wiki.yoctoproject.org/wiki/QA/Test_Reporting_Tool</bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>High</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>2.2 M2</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Benjamin Esquivel">benjamin.esquivel</reporter>
          <assigned_to name="Benjamin Esquivel">benjamin.esquivel</assigned_to>
          <cc>alexandru.c.georgescu</cc>
    
    <cc>anibal.limon</cc>
    
    <cc>belen.barros.pena</cc>
    
    <cc>bill.randle</cc>
    
    <cc>corneliux.stoicescu</cc>
    
    <cc>francisco.j.pedraza.gonzalez</cc>
    
    <cc>jose.perez.carranza</cc>
    
    <cc>joshuagloe</cc>
    
    <cc>leonardo.sandoval.gonzalez</cc>
    
    <cc>libertad.gonzalez.de.la.cruz</cc>
    
    <cc>markus.lehtonen</cc>
    
    <cc>richard.purdie</cc>
    
    <cc>sgw</cc>
          
          <qa_contact name="Jose Perez C">jose.perez.carranza</qa_contact>
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Don&apos;t know</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>61829</commentid>
    <comment_count>0</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-04-29 17:15:24 +0000</bug_when>
    <thetext>A test reporting tool is necessary for the various components that produce results. An example requirements of why such tool is needed are:

i. the ability to store results from multiple sources (performance, manual, automated)
ii. the ability to compare results with a tool that is designed for that purpose. Including comparing performance results which are trickier than functional testing
iii. the centralization of the test result storage to allow a number of things like back up, replication, extension, advanced filtering, etc.

These are just some of the benefits of having a tool for reporting. A wiki is proposed for the plan description:

https://wiki.yoctoproject.org/wiki/QA/Test_Reporting_Tool

Note that this is not intended to replace testopia as a test manager but to extend the testing capabilities by having a one stop shop for test reporting.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>62311</commentid>
    <comment_count>1</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2016-05-19 07:46:34 +0000</bug_when>
    <thetext>Hi Benjamin,
The current work on the project mentioned in this enhancement is available in GitHub at: https://github.com/fullvlad/CustomReports</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>62333</commentid>
    <comment_count>2</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-05-19 15:38:53 +0000</bug_when>
    <thetext>Thanks Alex, I believe that would be a valuable input</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>62438</commentid>
    <comment_count>3</comment_count>
    <who name="Joshua Lock">joshuagloe</who>
    <bug_when>2016-05-25 13:55:08 +0000</bug_when>
    <thetext>Ideally this tool would be able to consume, and compare, other quality related datasources such as the buildhistory from the autobuilder[1] and performance statistics.

1. http://git.yoctoproject.org/cgit/cgit.cgi/poky-buildhistory/</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>63591</commentid>
    <comment_count>4</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-07-01 17:59:43 +0000</bug_when>
    <thetext>an initial set of requirements are written at this section: 

https://wiki.yoctoproject.org/wiki/QA/Test_Reporting_Tool#General_Expectations</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>64064</commentid>
    <comment_count>5</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-07-15 17:16:35 +0000</bug_when>
    <thetext>The plan was written in the following bugs:

- bug 9954,
- bug 9956,
- bug 9957,
- bug 9958</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>64646</commentid>
    <comment_count>6</comment_count>
    <who name="Jose Perez C">jose.perez.carranza</who>
    <bug_when>2016-07-29 14:43:56 +0000</bug_when>
    <thetext>Test Plan Created at https://wiki.yoctoproject.org/wiki/QA/Test_Reporting_Tool</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>