Bug 3894

Summary: Piglit 3D testing
Product: [QA/Testing] Test Plans/Suite Reporter: Darren Hart <dvhart>
Component: test-plans/suiteAssignee: Alexandru Palalau <alexandrux.palalau>
Status: VERIFIED FIXED QA Contact:
Severity: enhancement    
Priority: Medium+ CC: alexandru.c.georgescu, bluelightning, corneliux.stoicescu, laurentiu.serban, nitin.a.kamble, richard.purdie, ross.burton, sgw
Version: unspecified   
Target Milestone: 1.6 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Bug Depends on:    
Bug Blocks: 4137, 4684    

Description Darren Hart 2013-02-15 06:01:24 UTC
Piglit is a GL functional testing tool. We need to move beyond glxgears and on to some better functional tests. Piglit looks like a good start and already has the start of a recipe from Ross, see: meta-oe-contrib, ross/piglit.

From Ross:
> There's a  few deps that are not in oe-core yet (numpy, waffle, glut) which is
> why it's there for now.

I believe waffle at least is optional, I built without it, and it seems to be there to allow for testing with alternate GL libraries, which I don't see as important for our testing (we want to test the one we built, th eonly one on the system).

This bug is for the completion of that recipe and the incorporation of this testing into the QA process.

Assigning to Ross for now, just because, Ross, feel free to discuss and reassign, but for now, this potato is yours.
Comment 1 Ross Burton 2013-04-25 14:53:23 UTC
Re-assigning to Alexandru to deal with as he wishes.  I'll gladly help but it's probably best if someone from QA handles the bulk of this.
Comment 2 Paul Eggleton 2013-04-29 15:05:05 UTC
This would almost certainly be a good candidate for the ptest framework.
Comment 3 Nitin Kamble 2013-06-12 15:26:43 UTC
Hi Alex,
   I am looking forward to use the test suite to do validation of the meta-intel BSPs. Can you plz keep me in informed in the development of this feature?

Thanks,
Nitin
Comment 4 Alexandru Georgescu 2013-06-17 09:55:30 UTC
Assigned to Alexandru Palalau. He will give an update this week regarding it.
Comment 5 Alexandru Palalau 2013-06-21 13:02:40 UTC
Well, at this moment I'm trying to build an image for NUC, but i'm getting the following:

DEBUG: Executing shell function do_compile
Traceback (most recent call last):
  File "setup.py", line 1, in <module>
    from setuptools import setup, find_packages
ImportError: No module named setuptools
ERROR: python setup.py build_ext execution failed.
ERROR: Function failed: do_compile (log file is located at /home/zeeblex/poky/build/tmp/work/x86_64-linux/python-mako-native/0.7.2-r0/temp/log.do_compile.2571)

Sorry for the late update.
Python 2.7.3
Comment 6 Ross Burton 2013-07-01 18:37:11 UTC
Sorry, just noticed this in my inbox!

python-setuptools is a separate package, you'll need to install that.
Comment 7 Alexandru Palalau 2013-07-10 10:41:16 UTC
Installing the python-setuptools package on host did not change anything.
I was able to get over this, by doing the following:
1. bitbake python-mako
2. bitbake python-mako-native


If I don'd do the first bitbake, python-mako-native still fails with the same error (it seems it does not depend on python-setuptools but python-mako does).
Comment 8 Alexandru Palalau 2013-07-23 13:50:22 UTC
I am able to build core-image-sato-sdk for NUC adding piglit recipe.
There are a few RDEPENDS that need to be added to the piglit_git recipe. 
Will send the patches this week.
Another issue is that we should be able to export the results in html format but in the current setup, the html templates that are needed for the script to run are missing.

Switched to 1.5 M3
Comment 9 Alexandru Palalau 2013-08-19 08:32:26 UTC
Ran some quick tests and got about 9200/9600 pass rate.
Also, I was able to export to html in order to get better view of the results.
Ross, any other things that should be added? 
Can I help in some other way in order for this feature to be completed?
Comment 10 Ross Burton 2014-01-14 23:58:21 UTC
Okay, piglit is merged into oe-core now.  Assigning back to Alex.
Comment 11 Alexandru Palalau 2014-02-21 10:01:30 UTC
Switching to resolved as piglit is already in oe-core and included in sdk images.
Created Testcase: https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=898 in order to use piglit on fullpass
Comment 12 Alexandru Palalau 2014-02-21 10:04:40 UTC
Switching to verified as this feature verification bug was already closed.