Bug 9997

Summary: oe-selftest: make available unittest-xml-reporting at the autobuilder workers
Product: [Infrastructure] AutoBuilder Reporter: Benjamin Esquivel <benjamin.esquivel>
Component: autobuilderAssignee: Michael Halstead <mhalstead>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium CC: benjamin.esquivel, infras.ab.watcher, Infras.watcher, joshuagloe, mariano.lopez, markus.lehtonen, mhalstead, monserratx.sedeno.bustos, pidge, sgw, srifenbark
Version: 2.2   
Target Milestone: 2.3 M2   
Hardware: x86   
OS: Multiple   
See Also: https://bugzilla.yoctoproject.org/show_bug.cgi?id=9682
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Bug Depends on: 10162    
Bug Blocks: 10580    

Description Benjamin Esquivel 2016-07-21 21:09:09 UTC
to make use of the xml results exporting feature of oe-selftest, the xmlrunner[1] module has to be available there.

One option is to install it there. Make sure it is installed via python3.

[1] https://github.com/xmlrunner/unittest-xml-reporting
Comment 1 Bill Randle 2016-07-22 15:38:33 UTC
Another AB installation requirement.
Comment 2 Benjamin Esquivel 2016-07-22 15:52:29 UTC
And this would also be a documentation change at the oe-selftest pre-requisites. CC'ing Scott
Comment 3 Scott Rifenbark 2016-07-22 17:05:03 UTC
Would this be applicable for all the supported distros?

So adding xmlrunner as a package to the four distros shown here http://www.yoctoproject.org/docs/2.2/ref-manual/ref-manual.html#required-packages-for-the-host-development-system would cover it?

Thanks, 
Scott
Comment 4 Benjamin Esquivel 2016-07-29 14:57:20 UTC
Indeed Scott, it applies for all supported distros as it is a python module. Now the interesting part is whether we have a section for installing python modules that do not come from the distro (not from dnf, zypper, apt-get, etc).

Also, this package adds functionality (exporting reports to xml) and while it is essential to the YoctoProject plans, it is not required for the regular user. So this is an optional thing.

Assigning it to you while in needinfo so we can continue the conversation.
Comment 5 Scott Rifenbark 2016-07-29 23:34:15 UTC
Thanks Benjamin, 

So it sounds like it is still not clear as to whether I can simply add the "xmlrunner" package to the four sections for oe_selftest that list the required packages.  I guess I will wait for further clarification. 

Thanks, 
Scott
Comment 6 Benjamin Esquivel 2016-08-01 17:32:27 UTC
(In reply to comment #5)
> Thanks Benjamin, 
> 
> So it sounds like it is still not clear as to whether I can simply add the
> "xmlrunner" package to the four sections for oe_selftest that list the
> required packages.  I guess I will wait for further clarification. 
> 
> Thanks, 
> Scott

that's the thing about the package, there is no xmlrunner distro package. However, there is a python package that can be installed via pip. Or the manual installation way.

Is there a python specific installs section at the manual? my guess is not. If so, should we add it for other things that will eventually show-up in the same way?
Comment 7 Scott Rifenbark 2016-08-01 19:02:39 UTC
Hi, 

The nearest thing we have is this section that lays out the minimal requirements for some stuff, which includes Python - http://www.yoctoproject.org/docs/2.2/ref-manual/ref-manual.html#required-git-tar-and-python-versions.  We have nothing beyond this information.

Scott
Comment 8 Benjamin Esquivel 2016-08-11 22:30:06 UTC
I will remove the dependency on documentation for this bug since it is not being offered yet as a user feature. When the test reporting is documented as a feature in the manual it will need to contain the xmlrunner dependency resolving via: pip install xmlrunner.
Comment 9 Scott Rifenbark 2016-08-12 17:27:42 UTC
Thanks Benjamin.
Comment 10 Benjamin Esquivel 2016-08-15 21:30:38 UTC
all instances of xmlrunner in this bug should be taken as unittest-xml-reporting. xmlrunner is another package which confuses the installation process.
Comment 11 Benjamin Esquivel 2016-08-18 19:33:56 UTC
bug 10162 is blocking this one as it causes oe-selftest problems.
Comment 12 Bill Randle 2016-08-18 19:54:17 UTC
Michael, did we install this on the ABs (using Python3)? If not, can we? Pypi seems to have a package for it; that might be easier to deal with than the git repo.
Comment 13 Benjamin Esquivel 2016-08-18 20:14:25 UTC
I would advice against installing this until bug 10162 is resolved. unittest-xml-reporting introduces an error at a subset of the tests.
Comment 14 Michael Halstead 2016-08-18 20:58:06 UTC
No not installed yet. I'll wait for an update from Benjamin.
Comment 15 Benjamin Esquivel 2016-11-03 20:59:11 UTC
this was tested in a staging autobuilder instance and it seems safe to enable it now.
Comment 16 Benjamin Esquivel 2016-11-03 21:00:29 UTC
changing the target milestone as it blocks a bug for M2.
Comment 17 Michael Halstead 2017-01-23 22:35:12 UTC
This is now available for the default python3 used by pokybuild on all workers. Both .yoctoproject.org and yocto.io.