Bug 9997 - oe-selftest: make available unittest-xml-reporting at the autobuilder workers
Summary: oe-selftest: make available unittest-xml-reporting at the autobuilder workers
Status: RESOLVED FIXED
Alias: None
Product: AutoBuilder
Classification: Infrastructure
Component: autobuilder (show other bugs)
Version: 2.2
Hardware: x86 Multiple
: Medium normal
Target Milestone: 2.3 M2
Assignee: Michael Halstead
QA Contact:
URL:
Whiteboard:
Depends on: 10162
Blocks: 10580
  Show dependency tree
 
Reported: 2016-07-21 21:09 UTC by Benjamin Esquivel
Modified: 2017-12-06 17:04 UTC (History)
11 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Benjamin Esquivel 2016-07-21 21:09:09 UTC
to make use of the xml results exporting feature of oe-selftest, the xmlrunner[1] module has to be available there.

One option is to install it there. Make sure it is installed via python3.

[1] https://github.com/xmlrunner/unittest-xml-reporting
Comment 1 Bill Randle 2016-07-22 15:38:33 UTC
Another AB installation requirement.
Comment 2 Benjamin Esquivel 2016-07-22 15:52:29 UTC
And this would also be a documentation change at the oe-selftest pre-requisites. CC'ing Scott
Comment 3 Scott Rifenbark 2016-07-22 17:05:03 UTC
Would this be applicable for all the supported distros?

So adding xmlrunner as a package to the four distros shown here http://www.yoctoproject.org/docs/2.2/ref-manual/ref-manual.html#required-packages-for-the-host-development-system would cover it?

Thanks, 
Scott
Comment 4 Benjamin Esquivel 2016-07-29 14:57:20 UTC
Indeed Scott, it applies for all supported distros as it is a python module. Now the interesting part is whether we have a section for installing python modules that do not come from the distro (not from dnf, zypper, apt-get, etc).

Also, this package adds functionality (exporting reports to xml) and while it is essential to the YoctoProject plans, it is not required for the regular user. So this is an optional thing.

Assigning it to you while in needinfo so we can continue the conversation.
Comment 5 Scott Rifenbark 2016-07-29 23:34:15 UTC
Thanks Benjamin, 

So it sounds like it is still not clear as to whether I can simply add the "xmlrunner" package to the four sections for oe_selftest that list the required packages.  I guess I will wait for further clarification. 

Thanks, 
Scott
Comment 6 Benjamin Esquivel 2016-08-01 17:32:27 UTC
(In reply to comment #5)
> Thanks Benjamin, 
> 
> So it sounds like it is still not clear as to whether I can simply add the
> "xmlrunner" package to the four sections for oe_selftest that list the
> required packages.  I guess I will wait for further clarification. 
> 
> Thanks, 
> Scott

that's the thing about the package, there is no xmlrunner distro package. However, there is a python package that can be installed via pip. Or the manual installation way.

Is there a python specific installs section at the manual? my guess is not. If so, should we add it for other things that will eventually show-up in the same way?
Comment 7 Scott Rifenbark 2016-08-01 19:02:39 UTC
Hi, 

The nearest thing we have is this section that lays out the minimal requirements for some stuff, which includes Python - http://www.yoctoproject.org/docs/2.2/ref-manual/ref-manual.html#required-git-tar-and-python-versions.  We have nothing beyond this information.

Scott
Comment 8 Benjamin Esquivel 2016-08-11 22:30:06 UTC
I will remove the dependency on documentation for this bug since it is not being offered yet as a user feature. When the test reporting is documented as a feature in the manual it will need to contain the xmlrunner dependency resolving via: pip install xmlrunner.
Comment 9 Scott Rifenbark 2016-08-12 17:27:42 UTC
Thanks Benjamin.
Comment 10 Benjamin Esquivel 2016-08-15 21:30:38 UTC
all instances of xmlrunner in this bug should be taken as unittest-xml-reporting. xmlrunner is another package which confuses the installation process.
Comment 11 Benjamin Esquivel 2016-08-18 19:33:56 UTC
bug 10162 is blocking this one as it causes oe-selftest problems.
Comment 12 Bill Randle 2016-08-18 19:54:17 UTC
Michael, did we install this on the ABs (using Python3)? If not, can we? Pypi seems to have a package for it; that might be easier to deal with than the git repo.
Comment 13 Benjamin Esquivel 2016-08-18 20:14:25 UTC
I would advice against installing this until bug 10162 is resolved. unittest-xml-reporting introduces an error at a subset of the tests.
Comment 14 Michael Halstead 2016-08-18 20:58:06 UTC
No not installed yet. I'll wait for an update from Benjamin.
Comment 15 Benjamin Esquivel 2016-11-03 20:59:11 UTC
this was tested in a staging autobuilder instance and it seems safe to enable it now.
Comment 16 Benjamin Esquivel 2016-11-03 21:00:29 UTC
changing the target milestone as it blocks a bug for M2.
Comment 17 Michael Halstead 2017-01-23 22:35:12 UTC
This is now available for the default python3 used by pokybuild on all workers. Both .yoctoproject.org and yocto.io.