Bug 8817 - LTP subset test suite fails
Summary: LTP subset test suite fails
Status: VERIFIED DUPLICATE of bug 8808
Alias: None
Product: General Runtime
Classification: Runtime
Component: General Runtime (show other bugs)
Version: 2.1
Hardware: NUC x86_64
: Undecided normal
Target Milestone: ---
Assignee: Saul Wold
QA Contact: Cristina Agurida
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2015-12-16 13:40 UTC by Cristina Agurida
Modified: 2016-02-03 16:19 UTC (History)
3 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: Regression (Used to work)
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Cristina Agurida 2015-12-16 13:40:51 UTC
STATUS: FAILED
BUILD: 2.1_M1_RC1: 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e
ENVIRONMENT: core-image-lsb-sdk on NUC
BSP: genericx86-64

STEPS TO REPRODUCE: 
For real hardware, run following component,
syscalls
fs
fsx
dio
io
mm
ipc
sched
math
nptl
pty
admin_tools
timers
commands

For QEMU, run following component
syscalls
mm
ipc
sched
math
nptl
pty
admin_tools
commands

Run Instructions:
LTP download: http://sourceforge.net/projects/ltp/files/LTP%20Source/ltp-20120401/ltp-full-20120401.bz2/download
(link is outdated, always use the last version released or the one found in the image)




build steps: refer to http://ltp.sourceforge.net

Run steps:
1. Build LTP with toolchain or in sdk image. Or use a sato-sdk image which has LTP already included in /opt/ltp
2. For QEMU, create the qemu target with "-m 512", which makes some 
memory stress cases pass. For some issues, we could only set 128M for 
qemuarm and 256M for qemumips.
3. Copy LTP folder into target, for example, /opt/ltp if you have built it yourself. Modify the 
default scenario file "scenario_groups/default", remove test suites not 
to be tested
4. Comment runtests/sched: hackbench, which is not suitable to run in emulators. Reminder (comment it also for Sugarbay Devices).
5. Comment oom01, oom02, oom03, oom04 in runtest/mm, which consume lots of memory
6. From /opt/ltp run: ./runltp -p -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/ltp/tmp &> result-M2-20101218.fulllog




EXPECTED OUTCOME: Check the result on wiki, https://wiki.yoctoproject.org/wiki/LTP_result, there should be no regression failure met.

Actual outcome:

runltp script fails with the following error:

INFO: creating /opt/ltp/output directory
INFO: creating /opt/ltp/results directory
BusyBox v1.24.1 (2015-12-08 11:46:55 GMT) multi-call binary.

Usage: mkdir [OPTIONS] DIRECTORY...
FATAL: Unable to make temporary directory
Comment 1 Richard Purdie 2015-12-17 11:57:23 UTC
This is the same root cause as 8808, busybox utils making it into an sdk image.

*** This bug has been marked as a duplicate of bug 8808 ***
Comment 2 Francisco Pedraza 2016-02-03 16:19:32 UTC
verified.