<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>11418</bug_id>
          
          <creation_ts>2017-04-26 17:08:59 +0000</creation_ts>
          <short_desc>Improve gstreamer testing</short_desc>
          <delta_ts>2018-11-19 06:58:02 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>7</classification_id>
          <classification>Build System, Metadata &amp; Runtime</classification>
          <product>OE-Core</product>
          <component>multimedia</component>
          <version>2.3</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>4.99</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Jussi Kukkonen">jku</reporter>
          <assigned_to name="yeoh ee peng">ee.peng.yeoh</assigned_to>
          <cc>alex.kanavin</cc>
    
    <cc>apoorv.sangal</cc>
    
    <cc>meta.mr.watcher</cc>
    
    <cc>meta.watcher</cc>
    
    <cc>robin.l.jordan</cc>
    
    <cc>ross.burton</cc>
    
    <cc>sgw</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>72866</commentid>
    <comment_count>0</comment_count>
    <who name="Jussi Kukkonen">jku</who>
    <bug_when>2017-04-26 17:08:59 +0000</bug_when>
    <thetext>We should not be finding GStreamer issues right around release time but that&apos;s what we seem to do. Let&apos;s see if there are low hanging fruit in automated testing that would allow us to catch at least some issues as they are merged.

Some potential tooling:
https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-validate/html/

I believe for core gstreamer there are test suites already, we&apos;d just want to choose what to run and when (and then keep the expected results updated). 

Doing automated testing with e.g. gstreamer-vaapi would be best but testing hardware acceleration on VM can be a little tricky... Even then, a script that QA or developers could run that gave gst-validate like output would be useful.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>72929</commentid>
    <comment_count>1</comment_count>
    <who name="Jussi Kukkonen">jku</who>
    <bug_when>2017-04-28 07:51:36 +0000</bug_when>
    <thetext>Forgot the repo links:

git://anongit.freedesktop.org/gstreamer/gst-devtools
git://anongit.freedesktop.org/gstreamer/gst-integration-testsuites</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>79525</commentid>
    <comment_count>2</comment_count>
    <who name="Maxin B. John">maxin.john</who>
    <bug_when>2018-02-21 07:57:47 +0000</bug_when>
    <thetext>Moving gstreamer bugs to Anuj.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>79638</commentid>
    <comment_count>3</comment_count>
    <who name="Anuj Mittal">anuj.mittal</who>
    <bug_when>2018-03-01 04:29:15 +0000</bug_when>
    <thetext>Ee Peng, can you please evaluate the current tests that we have and see if we can use test-suites available here for runtime testing?

I think that we might not be able to test vaapi codecs for the bsp testing using this without changing some of the code to have default codec changed. gstreamer-vaapi does provides some tests which can be built &amp; enabled but they need manual inspection, there&apos;s no image comparison to enable automated testing.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>82059</commentid>
    <comment_count>4</comment_count>
    <who name="yeoh ee peng">ee.peng.yeoh</who>
    <bug_when>2018-11-08 06:34:35 +0000</bug_when>
    <thetext>We developed some gstreamer CLI tests back in the Intel Ref Kit. Need to try porting this tests to poky. 
https://github.com/intel/intel-iot-refkit/blob/master/meta-iotqa/lib/oeqa/runtime/multimedia/gstreamer/gstreamer_cli.py</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>82060</commentid>
    <comment_count>5</comment_count>
    <who name="yeoh ee peng">ee.peng.yeoh</who>
    <bug_when>2018-11-08 08:19:19 +0000</bug_when>
    <thetext>Porting tests from Intel Ref Kit. 
http://lists.openembedded.org/pipermail/openembedded-core/2018-November/157437.html</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>82267</commentid>
    <comment_count>6</comment_count>
    <who name="yeoh ee peng">ee.peng.yeoh</who>
    <bug_when>2018-11-19 06:58:02 +0000</bug_when>
    <thetext>http://lists.openembedded.org/pipermail/openembedded-core/2018-November/157445.html</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>