<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>8832</bug_id>
          
          <creation_ts>2015-12-17 10:07:26 +0000</creation_ts>
          <short_desc>pTest - bash tests fail for 2.1_M1.rc1</short_desc>
          <delta_ts>2018-12-05 02:46:27 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Runtime Testing</product>
          <component>general</component>
          <version>2.1</version>
          <rep_platform>NUC</rep_platform>
          <op_sys>x86_64</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>WORKSFORME</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>2.7 M2</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Alexandru Georgescu">alexandru.c.georgescu</reporter>
          <assigned_to name="Changqing Li">changqing.li</assigned_to>
          <cc>chong.lu</cc>
    
    <cc>francisco.j.pedraza.gonzalez</cc>
    
    <cc>jair.de.jesus.gonzalez.plascencia</cc>
    
    <cc>liezhi.yang</cc>
    
    <cc>richard.purdie</cc>
    
    <cc>sgw</cc>
    
    <cc>yi.zhao</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Don&apos;t know</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>57328</commentid>
    <comment_count>0</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2015-12-17 10:07:26 +0000</bug_when>
    <thetext>Commit: 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e
Previous Commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1


https://wiki.yoctoproject.org/wiki/Ptest_5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e

Results for NUC ptest bash 2015-12-10:
********************************
Tests that failed now and worked last time: 5
run-nquote1
run-builtins
run-printf
run-type
run-read
Tests that passed now and and failed last time: 0

Tests that were skipped now and worked last time: 0

Tests that were skipped last time and worked now: 0
Tests that failed now: 12
run-assoc
run-nquote1
run-builtins
run-printf
run-intl
run-coproc
run-lastpipe
run-type
run-read
run-test
run-trap
run-execscript</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58175</commentid>
    <comment_count>1</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2016-01-25 10:15:12 +0000</bug_when>
    <thetext>Tested with 2.0.1.rc2:
poky: dd0ba9ea4a11ab15348d4fe3574e4b28784db82f
previous commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1


Results for NUC ptest bash 2016-01-18:
********************************
Tests that failed now and worked last time: 2
run-builtins
run-printf



Tests that failed now: 9
run-assoc
run-builtins
run-printf
run-intl
run-coproc
run-lastpipe
run-test
run-trap
run-execscript</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58502</commentid>
    <comment_count>2</comment_count>
    <who name="Francisco Pedraza">francisco.j.pedraza.gonzalez</who>
    <bug_when>2016-02-03 15:09:55 +0000</bug_when>
    <thetext>(In reply to comment #0)
&gt; Commit: 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e
&gt; Previous Commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1
&gt; 
&gt; 
&gt; https://wiki.yoctoproject.org/wiki/
&gt; Ptest_5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e
&gt; 
&gt; Results for NUC ptest bash 2015-12-10:
&gt; ********************************
&gt; Tests that failed now and worked last time: 5
&gt; run-nquote1
&gt; run-builtins
&gt; run-printf
&gt; run-type
&gt; run-read
&gt; Tests that passed now and and failed last time: 0
&gt; 
&gt; Tests that were skipped now and worked last time: 0
&gt; 
&gt; Tests that were skipped last time and worked now: 0
&gt; Tests that failed now: 12
&gt; run-assoc
&gt; run-nquote1
&gt; run-builtins
&gt; run-printf
&gt; run-intl
&gt; run-coproc
&gt; run-lastpipe
&gt; run-type
&gt; run-read
&gt; run-test
&gt; run-trap
&gt; run-execscript



Here are the results for YP 2.1_M2.rc1
AB Link: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1_M2.rc1/ptest/machines/genericx86-64/core-image-sato-sdk-genericx86-64.hddimg

https://wiki.yoctoproject.org/wiki/Ptest_3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c

Ptest 3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c
Ran on a NUC and compared with commit 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e


Tests that passed now and and failed last time: 7

run-assoc
run-nquote1
run-coproc
run-type
run-read
run-test
run-execscript
Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 5

run-builtins
run-printf
run-intl
run-lastpipe
run-trap</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>72147</commentid>
    <comment_count>3</comment_count>
    <who name="Jair Gonzalez">jair.de.jesus.gonzalez.plascencia</who>
    <bug_when>2017-04-06 17:55:20 +0000</bug_when>
    <thetext>There are 4 tests still failing on 2.3 M3 rc2.

********** Failures *******

FAIL: run-intl
FAIL: run-lastpipe
FAIL: run-trap
FAIL: run-vredir

***************************

Results:
https://wiki.yoctoproject.org/wiki/Ptest_6e20b31d5d17133e0fca086e12a0ad06ab5c4cc8</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>72149</commentid>
    <comment_count>4</comment_count>
    <who name="Jair Gonzalez">jair.de.jesus.gonzalez.plascencia</who>
    <bug_when>2017-04-06 17:59:05 +0000</bug_when>
    <thetext>Correcting the link for results on 2.3 M3 rc2:

https://wiki.yoctoproject.org/wiki/Ptest_415b72ffcbd26e5f3664370d8b2a9b8105fb6342</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>78363</commentid>
    <comment_count>5</comment_count>
    <who name="Yi Zhao">yi.zhao</who>
    <bug_when>2017-11-28 01:21:25 +0000</bug_when>
    <thetext>*** Bug 5698 has been marked as a duplicate of this bug. ***</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>82400</commentid>
    <comment_count>6</comment_count>
    <who name="Changqing Li">changqing.li</who>
    <bug_when>2018-12-05 02:46:27 +0000</bug_when>
    <thetext>only have 2 failed now,  and these two failed are not real fail.

1. for run-trap,  it have warning,  only line number difference is not real fail.
run-trap
warning: UNIX versions number signals and schedule processes differently.
warning: If output differing only in line numbers is produced, please
warning: do not consider this a test failure.
71,72d70
&lt; +[8] false
&lt; +[8] cat
73a72,73
&gt; +[8] cat
&gt; +[8] false

2. this is failed since run ptest as root user,  it can pass with non-root user
. According to  upstream comments, the whole test should run under non-root user.
run-new-exp
warning: two of these tests will fail if your OS does not support
warning: named pipes or the /dev/fd filesystem.  If the tests of the
warning: process substitution mechanism fail, please do not consider
warning: this a test failure
warning: if you have exported variables beginning with the string _Q,
warning: diff output may be generated.  If so, please do not consider
warning: this a test failure
627c627
&lt; argv[1] = &lt;host(2)[4.4]# &gt;
---
&gt; argv[1] = &lt;host(2)[4.4]$ &gt;
FAIL: run-new-exp</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>