Bug 5790

Summary: Automate test results logging in Testopia using XMLRPC interface
Product: [QA/Testing] Build Testing Reporter: Stoicescu COrnel <stoicescu_cornel>
Component: generalAssignee: Lucian Musat <georgex.l.musat>
Status: VERIFIED FIXED QA Contact: Alexandru Georgescu <alexandru.c.georgescu>
Severity: enhancement    
Priority: Medium CC: alexandru.c.georgescu, bogdanx.a.voiculescu, srifenbark
Version: 1.6   
Target Milestone: 1.9 M1   
Hardware: x86   
OS: Multiple   
Whiteboard: 17 June 2015: Set the documentation flag to "No"
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Stoicescu COrnel 2014-02-05 13:24:18 UTC
Testopia has a XMLRPC comunication interface that can be accessed to automate test results logging from external scripts. 

There is a python script in the Testopia sources that accesses this interface but needs update and trimming.

What needs to be done:
1) Create a working base module for XMLRPC communication with a Testopia installation (work in progress at the moment of this writing)

2) Create a importable module that uses the previous (abstract) one to manipulate Testopia elements for our specific needs. This module could then be used in oe-selftest, automated runtime tests or as an external tool to automate test results logging in Testopia.
Comment 1 Stoicescu Cornel 2014-03-17 16:31:23 UTC
Status update:
- the script is up and functional.
- we need to test it against a clone of the production server before it is sent for review, to make sure we sort all remaining (evident) issues out.

NOTE: One of the modules used by the script is derived from another module taken from the Testopia installation and is under Mozilla Public License Version 1.1 . Looking into how to adapt this for Yocto.
Comment 2 Stoicescu Cornel 2014-03-19 16:10:33 UTC
I am not sure this will make it into 1.6 because we have passed the feature freeze. This feature does not impact the build system in any way though and should not introduce any instability.

It should be ready before 1.6 is released. Leaving a general 1.6 milestone for now and will move to 1.7 when the time comes, if necessary.
Comment 3 Stoicescu Cornel 2014-04-02 07:13:20 UTC
Moving to 1.7 and will try and push it to 1.6.1 as well.
Comment 4 Stoicescu Cornel 2014-04-24 09:40:17 UTC
This is still in testing phase. Should be functional in the 1.7 M2 time-frame.
Comment 5 Stoicescu Cornel 2014-07-30 08:06:44 UTC
Moving to M4. Some internal networking issues are blocking this from testing and implementation.
Comment 6 Stoicescu Cornel 2014-09-19 11:34:09 UTC
We have the scripts to finish this but we cannot test this due to an internal proxy issue. 

I passed my work on this to Lucian and he will continue the debugging and implementation if we decide to use this.

Also moving to 1.8
Comment 7 Alexandru Georgescu 2015-04-09 15:14:42 UTC
(In reply to comment #6)
> We have the scripts to finish this but we cannot test this due to an
> internal proxy issue. 
> 
> I passed my work on this to Lucian and he will continue the debugging and
> implementation if we decide to use this.
> 
> Also moving to 1.8

This is done but needs some review. So will mark it to 1.9_M1.
Comment 8 Scott Rifenbark 2015-06-01 23:11:47 UTC
Hi, 

I am not sure this affects the YP user documentation.  It might affect some other type of documentation, such as QA procedures.  I don't know.  But, I am entering this comment to rule out the YP user docs as being impacted by this issue.  If I am wrong, please correct me.

Scott
Comment 10 Scott Rifenbark 2015-06-17 13:25:25 UTC
(In reply to comment #9)
> Added the scripts to poky-contrib here:
> http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=lucian/
> testopia-xmlrpc&id=0d76dafa87db18faedee5d70a1b2f22785adcf0e

I do not think the user manuals change as a result of these scripts.  We currently have no instruction on XMLRPC or Testopia.  I am marking the documentation flag as "no".

Scott
Comment 11 Bogdan Alexandru Voiculescu 2015-07-10 07:41:36 UTC
Verified