Bug 12145 - ptest-bash cases failed in 2.4rc1
Summary: ptest-bash cases failed in 2.4rc1
Status: RESOLVED FIXED
Alias: None
Product: Build Testing
Classification: QA/Testing
Component: general (show other bugs)
Version: 2.4
Hardware: NUC x86_64
: High major
Target Milestone: 2.4 M4
Assignee: Juro Bystricky
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2017-09-29 21:35 UTC by oscar lopez arandas
Modified: 2017-10-12 00:11 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: Don't know


Attachments
full-log (1.37 MB, application/octet-stream)
2017-09-29 21:35 UTC, oscar lopez arandas
no flags Details
2.4_M4_rc2 (5.32 MB, text/x-log)
2017-10-10 21:48 UTC, oscar lopez arandas
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description oscar lopez arandas 2017-09-29 21:35:39 UTC
Created attachment 4040 [details]
full-log

tests were executed and The pass rate goes back the percentage, observing 5 failures on the bash

poky : 592c3449697ce39bf07864fafd7f0a61ca230561
2.4 rc1 
HW: NUC  6i5SYH 
image:
https://autobuilder.yocto.io/pub/releases/yocto-2.4.rc1/machines/genericx86-64/core-image-sato-sdk-ptest-genericx86-64.hddimg

https://wiki.yoctoproject.org/wiki/Ptest_592c3449697ce39bf07864fafd7f0a61ca230561
STEPS: automatic
 1. Download pTest image from autobuilder( you can find core-image-sato-sdk image in pTest directory)

* we test it on NUC with genericx86-64

2. Install the image on DUT (using legacy boot)

3) Configure the network so it be able to work externally:

- Export the proxy using "export http_proxy=<add your proxy link>" command eg


And check if you have internet connection, typing on terminal:
$ wget www.google.com

4. In command line type
$ ptest-runner > ptest.log 

EXPECTED OUTCOME:
The pass rate goes up the percentage


ACTUAL OUTCOME:
The pass rate goes back the percentage
==========================================
FAIL: run-vredir
FAIL: run-read
FAIL: run-new-exp
=============================================
full log in attachment
Comment 1 oscar lopez arandas 2017-10-10 21:45:16 UTC
tests were executed and The pass rate goes up  the percentage, observing 3 failures on the results.

tests were executed and The pass rate goes up  the percentage, observing 9 failures on the results.

POKY : 2.4_M4_r2 COMMIT:da05a01423a60a23cd1073eb0ad3776e5bf4f2a8
HW: NUC  6i5SYH 
IMAGES:
https://autobuilder.yocto.io/pub/releases/yocto-2.4.rc2/machines/genericx86-64/core-image-sato-sdk-ptest-genericx86-64.hddimg

Results  Chart table:
https://wiki.yoctoproject.org/wiki/Ptest_da05a01423a60a23cd1073eb0ad3776e5bf4f2a8

EXPECTED OUTCOME:
The pass rate goes up the percentage


ACTUAL OUTCOME:
The pass rate goes up the percentage
========================
FAIL: run-lastpipe
FAIL: run-new-exp
FAIL: run-vredir
============================

note:
full=log in attachent
Comment 2 oscar lopez arandas 2017-10-10 21:48:18 UTC
Created attachment 4073 [details]
2.4_M4_rc2
Comment 3 Juro Bystricky 2017-10-12 00:11:55 UTC
This fixes one test:
http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?h=master-next&id=07e3da7b399dea8fca7f923e210b9959b949f6e9

The patch above will improve statistics, but there are several additional tests that fail, individual bugs need to be filed for each one.