<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>6260</bug_id>
          
          <creation_ts>2014-05-01 17:49:23 +0000</creation_ts>
          <short_desc>ptests requirements often not met</short_desc>
          <delta_ts>2014-11-25 10:23:48 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>7</classification_id>
          <classification>Build System, Metadata &amp; Runtime</classification>
          <product>Other YP Layers</product>
          <component>layers</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>1.8</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Volker">lists.volker</reporter>
          <assigned_to name="Maxin B. John (inactive)">maxin.baby.john</assigned_to>
          <cc>alexandru.c.georgescu</cc>
    
    <cc>poky.bs.watcher</cc>
    
    <cc>poky.watcher</cc>
    
    <cc>sgw</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Yes (doc changes required)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>43085</commentid>
    <comment_count>0</comment_count>
    <who name="Volker">lists.volker</who>
    <bug_when>2014-05-01 17:49:23 +0000</bug_when>
    <thetext>A lot of ptests failed in my case because of unmet RDEPENDS settings.

Examples:
- ptests does not run correctly if the rootfs is read-only. But the read-only rootfs provides writeable space.
- sed from busybox does not provide all options as GNU sed, so another test failed (perl)
- some tests try to execute bash, which is not installed on my system (e.g. strace)
- files not found (python)
- wget (I think the busybox wget) tests failed because it did not check for networking (and runqemu did not come up with a proper /etc/resolv.conf).


I didn&apos;t find much documentation about ptests. And none of them stated these problems, nor how to test your ptest by using only a minimal image (e.g. without bash and GNU sed).

Maybe there could be a quick warning message echo&apos;d in &apos;ptest-runner&apos; that it is not that stable yet and work in progress.

I see that the Yocto build system also runs some tests. Maybe it would be possible to create some additional ones that also executes ptest-runner?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>43087</commentid>
    <comment_count>1</comment_count>
    <who name="Volker">lists.volker</who>
    <bug_when>2014-05-01 19:58:47 +0000</bug_when>
    <thetext>Regarding the automatic run of ptests I found #4114</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>43126</commentid>
    <comment_count>2</comment_count>
    <who name="Saul Wold">sgw</who>
    <bug_when>2014-05-05 21:04:35 +0000</bug_when>
    <thetext>The -ptest packages should have the correct RDEPENDS, so the perl-ptest should 
RDEPENDS on sed.  and so forth.

Regarding the read-only, it may not make sense to have these kinds of tests on 
read-only because we just don&apos;t know where each test is trying to write to, if 
you can enumerate that further, we can look at what fixes are required there.

We are working on incorporating more testing (including ptest) into the test 
automation infrastructre.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>43137</commentid>
    <comment_count>3</comment_count>
    <who name="Maxin B. John (inactive)">maxin.baby.john</who>
    <bug_when>2014-05-06 14:10:26 +0000</bug_when>
    <thetext>I will start addressing the ptest related problems. 

Here are some documentation about ptest framework:
https://wiki.yoctoproject.org/wiki/Ptest
http://daniel.haxx.se/blog/2012/08/31/ptest-because-make-test-is-insufficient/</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>43210</commentid>
    <comment_count>4</comment_count>
    <who name="Maxin B. John (inactive)">maxin.baby.john</who>
    <bug_when>2014-05-09 08:22:05 +0000</bug_when>
    <thetext>Updated the perl ptest: 
http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=b537c2fbf980122f25c9842f04915dd962f3f112</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>47031</commentid>
    <comment_count>5</comment_count>
    <who name="Saul Wold">sgw</who>
    <bug_when>2014-11-14 18:45:12 +0000</bug_when>
    <thetext>This needs further enumeration as to what additional ptest packages have RDEPENDS issues or possibly close this one and open individual bugs for each issue.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>47179</commentid>
    <comment_count>6</comment_count>
    <who name="Maxin B. John (inactive)">maxin.baby.john</who>
    <bug_when>2014-11-25 10:23:48 +0000</bug_when>
    <thetext>Hi,

Agree with Saul. We can open individual bugs for dependency issues when we encounter it.

Best Regards,
Maxin</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>