Bug 11202

Summary: QA: Validate Flatpak-based 3rd party application support
Product: [QA/Testing] IoT Reference OS Kit Testing Reporter: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia>
Component: intel-iot-refkit-automated-runtime-testingAssignee: yeoh ee peng <ee.peng.yeoh>
Status: RESOLVED FIXED QA Contact: Choong Yin Thong <yin.thong.choong>
Severity: enhancement    
Priority: Medium+ CC: jair.de.jesus.gonzalez.plascencia, krisztian.litkey, sgw
Version: 2.4   
Target Milestone: 2.4 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Bug Depends on: 11086    
Bug Blocks:    

Description Jair Gonzalez 2017-03-21 23:00:36 UTC
Add a test suite to validate Refkit supports flatpak-based 3rd party applications.
Comment 1 Jair Gonzalez 2017-04-17 21:29:33 UTC
After an agreement with the Refkit team, the progress on the minimal required sanity tests to release a feature will be tracked on the same bug issue used to track the feature's development. Analogous QA bugs like this one may be created if required, and will be used to track the development of more extensive test cases.

According to this, the dependence will be inverted in relation to the feature bug.
Comment 2 Jair Gonzalez 2017-06-05 19:26:41 UTC
Hello ~[ee peng
Comment 3 Jair Gonzalez 2017-06-05 19:47:28 UTC
Hello Ee Peng,

Could you please take a look at this issue? As stated on feature bug 11086 by Kristian Litkey "There is a very basic sanity test which simply checks if the minimum set of files necessary for flatpak 3rd-party application support are present in the image".

He also provides further input about how the tests could be extended further. 

According to this, it may be necessary to close this issue once Kristian's patchset is integrated, and, according to your prioritization analysis, use a new issue to track the test coverage extension.
Comment 4 yeoh ee peng 2017-06-06 02:09:56 UTC
Hi Jair,

I verified that basic sanity tests was created by Krisztian inside the meta-flatpak itself. Since the sanity tests was already created, shall we update the status to "Resolved"?

https://github.com/klihub/meta-flatpak/blob/master/lib/oeqa/runtime/sanity/flatpak.py
Comment 5 Jair Gonzalez 2017-06-07 00:35:00 UTC
Hi Ee Peng,

If you decide no more tests will be added for this milestone, I would suggest waiting for the patchset to trickle down from OpenEmbedded first as mentioned on bug 11086. Once the patchset is in the repository and bug 11086 is closed, you could close this too by updating it to "Resolved" as you indicate.
Comment 6 yeoh ee peng 2017-07-11 02:17:33 UTC
Hi Jair,

I had verified that flatpak bugzilla had been resolved and it included basic tests. 
https://bugzilla.yoctoproject.org/show_bug.cgi?id=11086

I will close this bugzilla and we will open new bugzilla in the future when QA team develop more tests for flatpak.