Bug 9133 - QA: Eclipse plugin testing integrate into AB
Summary: QA: Eclipse plugin testing integrate into AB
Status: CLOSED WONTFIX
Alias: None
Product: Runtime Testing
Classification: QA/Testing
Component: general (show other bugs)
Version: 2.1.2
Hardware: x86 Multiple
: Medium enhancement
Target Milestone: Future
Assignee: Unassigned
QA Contact:
URL:
Whiteboard:
Depends on: 9597
Blocks:
  Show dependency tree
 
Reported: 2016-02-17 21:28 UTC by Aníbal Limón
Modified: 2019-05-23 15:06 UTC (History)
7 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Aníbal Limón 2016-02-17 21:28:18 UTC
We need to integrate eclipse plugin testing into AB/buildbot,

Current work at,

http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=vhangan/eclipse-framework
Comment 1 Benjamin Esquivel 2016-02-18 21:10:04 UTC
Hi Anibal, Can you add a bug for the Fedora only testing issue?
Comment 2 Benjamin Esquivel 2016-07-12 20:28:25 UTC
Re-assigning to Edwin.
Comment 3 Tim Orling 2016-08-11 03:25:23 UTC
This makes sense for a Linux only plugin, but since it depends on pygobject and GNOME-python it won't work on the Windows and Mac clients we are trying to add. It's great that it uses python for the tests, but requiring GNOME is a deal breaker for the larger picture. Hopefully, in the not too distant future, the Eclipse EASE project will allow us to return to using python for the test scripts (http://www.eclipse.org/ease/).

Many Eclipse plugins use SWTBot for UI testing (http://www.eclipse.org/swtbot/). The newest player in the Eclipse testing world is RCPTT (http://www.eclipse.org/rcptt/), but the C/C++ Development Tools (CDT) project has found debugging of RCPTT tests themselves to be difficult. Since most of what we are providing is CDT related, for now it makes the most sense to stick with SWTBot ("swat-bot").

Very preliminary testing using SWTBot is available in the following branch:
http://git.yoctoproject.org/cgit/cgit.cgi/eclipse-poky-contrib/log/?h=timo/neon-master-ui-tests-wip

For now, the tests can be run in the IDE, semi-automatically (the IDE has to be launched manually, but the test suite runs automatically). Using Xvnc and metacity the tests can be run fully automatically and "headless", and many Eclipse projects do this on Hudson CI (http://wiki.eclipse.org/SWTBot/Automate_test_execution). The test cases themselves are (unfortunately) written in Java and require knowledge of the underlying SWT widgets, but the learning curve is not too steep. SWTBot provides a Recorder/Generator that can help with creating new test cases (http://wiki.eclipse.org/SWTBot/Generator), although it is limited to the UI thread in which it is launched. This means, for instance, that dialog boxes become difficult to generate test cases for. It is possible that the RCPTT UI tools may be able to help bridge the gap (helping to capture events from multiple UI threads), but this has not yet been tested.

The test suite results from SWTBot can be output to XUnit format and should therefore be "easy" to consume into a larger scoped QA report.
Comment 4 Leonardo Sandoval Gonzalez 2016-08-25 17:34:45 UTC
This enhancement wont be ready for M3, and M4 is just for bugs. Moving to 2.3M1.
Comment 5 Leonardo Sandoval Gonzalez 2016-11-07 19:25:27 UTC
As in bug 9140, Benjamin needs to figure out current status.
Comment 6 Tim Orling 2016-11-07 21:51:33 UTC
RCPTT (Rich Client Platform Testing Tool) is Java/Eclipse based and therefore does not care about the distro or even platform (Mac/Windows/Linux). BZ#9597

The current in-process implementation uses a Docker container to run the tests. The container can be run on the AB, but the launcher script for the Docker container can be run bare-metal/natively as well. It does require some setup for QEMU in the background.
Comment 7 Benjamin Esquivel 2016-11-08 19:05:15 UTC
The direction here is to collaborate with Tim on the RCPTT
Comment 8 Benjamin Esquivel 2016-11-08 19:10:46 UTC
Reassigning back to José so he can choose someone from QA To work on this.
Comment 9 Jose Perez C 2016-11-08 19:32:54 UTC
Assign it to Humberto as he is teh current owner of QA of Eclipse Plugin
Comment 10 Humberto Ibarra 2017-01-25 20:18:20 UTC
Still waiting for 9597 to be done. Moving to M3.
Comment 11 Humberto Ibarra 2017-02-08 21:04:07 UTC
Depends on a different bug and it doesn't look like it will be ready on time.
Comment 12 Jair Gonzalez 2017-08-29 21:54:09 UTC
Moving to 2.5, due to limited resources.
Comment 13 Jair Gonzalez 2017-08-29 22:02:31 UTC
Returning version to 2.1
Comment 14 Armin Kuster 2019-05-23 15:00:09 UTC
eclipse has been dropped.
Comment 15 Armin Kuster 2019-05-23 15:06:51 UTC
closing