<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>12777</bug_id>
          
          <creation_ts>2018-06-08 06:49:57 +0000</creation_ts>
          <short_desc>oeqa: test suite need to be categorized</short_desc>
          <delta_ts>2018-06-14 14:38:43 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Runtime Testing</product>
          <component>general</component>
          <version>unspecified</version>
          <rep_platform>All</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>NOTABUG</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Undecided</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>---</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Lei Yang">lei.yang</reporter>
          <assigned_to name="Apoorv">apoorv.sangal</assigned_to>
          <cc>lei.yang</cc>
    
    <cc>liezhi.yang</cc>
    
    <cc>mark.asselstine</cc>
    
    <cc>mark.hatle</cc>
    
    <cc>richard.purdie</cc>
    
    <cc>zhenfeng.zhao</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Don&apos;t know</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>80739</commentid>
    <comment_count>0</comment_count>
    <who name="Lei Yang">lei.yang</who>
    <bug_when>2018-06-08 06:49:57 +0000</bug_when>
    <thetext>we have kernel,userspace, toolchian tests in oeqa currently, and all of those tests are under the same directory right now, it&apos;s kind hard to know which one is for kernel, which one is for toolchain,etc. 

Imaging you&apos;re a kernel developer, you did a big change to the kernel code, you want to know the overall impact to the different kernel sub-system, you might want to run all of the exsisting kernel tests without running other tests like toolchain or userspace.  

Imaging you want to know the kernel test report after applying something like meltdow/spectre patches.

how could we do that? 

Lei</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>80786</commentid>
    <comment_count>1</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2018-06-14 14:38:43 +0000</bug_when>
    <thetext>This is a good question but doesn&apos;t really lend itself to a bugzilla entry. This is something which should be discussed on the mailing list and then once an approach is agreed we can have a bugzilla entry for it.

The code is structured where similar tests are currently co-located. Rather than restructuring the code by area we may just want to add &quot;tags&quot; to test or some other similar approach so particular groups can be created and run.

Closing as NOTABUG so mailing list discussion can happen and an approach can be agreed.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>