Bug 12875

Summary: [2.6 M2 rc1] eSDK devtool automated tests were skipped due to unexpected error on dependency logic
Product: [QA/Testing] Runtime Testing Reporter: yeoh ee peng <ee.peng.yeoh>
Component: generalAssignee: Richard Purdie <richard.purdie>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+    
Version: 2.6   
Target Milestone: 2.6 M3   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Don't know

Description yeoh ee peng 2018-08-09 10:09:14 UTC
Step to reproduce.
1. clone poky, source oe-init-build-env
2. bitbake core-image-sato-sdk 
3. bitbake core-image-sato-sdk -c populate_sdk_ext
4. bitbake core-image-sato-sdk -c testsdkext

Expected:
When devtool.DevtoolTest.test_devtool_location passed, other devtool tests that depending on devtool.DevtoolTest.test_devtool_location shall be executed.

Actual: 
When devtool.DevtoolTest.test_devtool_location passed, other devtool tests that depending on devtool.DevtoolTest.test_devtool_location were skipped.

NOTE: test_devtool_add_reset (devtool.DevtoolTest)
NOTE:  ... skipped "Test case devtool.DevtoolTest.test_devtool_add_reset depends on test_devtool_location but it didn't pass/run."
NOTE: test_devtool_build_cmake (devtool.DevtoolTest)
NOTE:  ... skipped "Test case devtool.DevtoolTest.test_devtool_build_cmake depends on test_devtool_location but it didn't pass/run."
NOTE: test_devtool_build_esdk_package (devtool.DevtoolTest)
NOTE:  ... skipped "Test case devtool.DevtoolTest.test_devtool_build_esdk_package depends on test_devtool_location but it didn't pass/run."
NOTE: test_devtool_build_make (devtool.DevtoolTest)
NOTE:  ... skipped "Test case devtool.DevtoolTest.test_devtool_build_make depends on test_devtool_location but it didn't pass/run."
NOTE: test_devtool_kernelmodule (devtool.DevtoolTest)
NOTE:  ... skipped "Test case devtool.DevtoolTest.test_devtool_kernelmodule depends on test_devtool_location but it didn't pass/run."
NOTE: test_extend_autotools_recipe_creation (devtool.DevtoolTest)
NOTE:  ... skipped "Test case devtool.DevtoolTest.test_extend_autotools_recipe_creation depends on test_devtool_location but it didn't pass/run."
NOTE: test_recipes_for_nodejs (devtool.DevtoolTest)
NOTE:  ... skipped "Test case devtool.DevtoolTest.test_recipes_for_nodejs depends on test_devtool_location but it didn't pass/run."
INFO: Copying the SDK to destination
INFO: Unpacking SDK
INFO: Successfully unpacked /data/eyeoh7/tmp/poky_qa/build-image-sato-sdk/tmp/work/qemux86-poky-linux/core-image-sato-sdk/1.0-r0/testsdkext/esdk_publish/poky-glibc-x86_64-core-image-sato-sdk-i586-toolchain-ext-2.5+snapshot.sh to /data/eyeoh7/tmp/poky_qa/build-image-sato-sdk/tmp/work/qemux86-poky-linux/core-image-sato-sdk/1.0-r0/testsdkext/esdk_publish
INFO: SDK published successfully
NOTE: test_sdk_update_http (devtool.SdkUpdateTest)
NOTE:  ... ERROR
NOTE: ======================================================================
NOTE: ERROR: test_sdk_update_http (devtool.SdkUpdateTest)
NOTE: ----------------------------------------------------------------------
NOTE: Traceback (most recent call last):
  File "/data/eyeoh7/tmp/poky_qa/meta/lib/oeqa/sdkext/cases/devtool.py", line 124, in test_sdk_update_http
    output = self._run("devtool sdk-update \"%s\"" % self.http_url)
  File "/data/eyeoh7/tmp/poky_qa/meta/lib/oeqa/sdkext/case.py", line 21, in _run
    shell=True, env=env, universal_newlines=True)
  File "/usr/lib/python3.5/subprocess.py", line 626, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.5/subprocess.py", line 708, in run
    output=stdout, stderr=stderr)
oeqa.utils.subprocesstweak.OETestCalledProcessError: Command '. /data/eyeoh7/tmp/poky_qa/build-image-sato-sdk/tmp/work/qemux86-poky-linux/core-image-sato-sdk/1.0-r0/testsdkext/environment-setup-i586-poky-linux > /dev/null; devtool sdk-update "http://127.0.0.1:33613";' returned non-zero exit status 8
Standard Output: NOTE: Starting bitbake server...
NOTE: Starting bitbake server...
ERROR: Cannot dowload files from http://127.0.0.1:33613

----------------------------------------------------------------------
NOTE: Ran 19 tests in 209.807s
NOTE: FAILED
NOTE:  (errors=1, skipped=7)
RESULTS:
RESULTS - buildcpio.BuildCpioTest.test_cpio - Testcase -1: PASSED (48.80s)
RESULTS - buildgalculator.GalculatorTest.test_galculator - Testcase -1: PASSED (31.03s)
RESULTS - buildlzip.BuildLzipTest.test_lzip - Testcase -1: PASSED (4.95s)
RESULTS - gcc.GccCompileTest.test_gcc_compile - Testcase -1: PASSED (0.11s)
RESULTS - gcc.GccCompileTest.test_gpp2_compile - Testcase -1: PASSED (0.13s)
RESULTS - gcc.GccCompileTest.test_gpp_compile - Testcase -1: PASSED (0.17s)
RESULTS - gcc.GccCompileTest.test_make - Testcase -1: PASSED (0.12s)
RESULTS - perl.PerlTest.test_perl_exists - Testcase -1: PASSED (0.01s)
RESULTS - perl.PerlTest.test_perl_works - Testcase -1: PASSED (0.01s)
RESULTS - python.PythonTest.test_python3 - Testcase -1: PASSED (0.06s)
RESULTS - devtool.DevtoolTest.test_devtool_add_reset - Testcase -1: SKIPPED (0.00s)
RESULTS - devtool.DevtoolTest.test_devtool_build_cmake - Testcase 1607: SKIPPED (0.00s)
RESULTS - devtool.DevtoolTest.test_devtool_build_esdk_package - Testcase 1606: SKIPPED (0.00s)
RESULTS - devtool.DevtoolTest.test_devtool_build_make - Testcase 1605: SKIPPED (0.00s)
RESULTS - devtool.DevtoolTest.test_devtool_kernelmodule - Testcase 1609: SKIPPED (0.00s)
RESULTS - devtool.DevtoolTest.test_devtool_location - Testcase -1: PASSED (0.01s)
RESULTS - devtool.DevtoolTest.test_extend_autotools_recipe_creation - Testcase 1608: SKIPPED (0.00s)
RESULTS - devtool.DevtoolTest.test_recipes_for_nodejs - Testcase 1610: SKIPPED (0.00s)
RESULTS