Bug 11917

Summary: (buildoptions) Failure on test_arch_work_dir and layer_with_out_git_dir
Product: [Build System, Metadata & Runtime] OE-Core Reporter: oscar lopez arandas <oscarx.lopez.arandas>
Component: configurationAssignee: oscar lopez arandas <oscarx.lopez.arandas>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: alex.kanavin, randy.macleod
Version: 2.4   
Target Milestone: 2.4 M4   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
logAttach
none
full_log none

Description oscar lopez arandas 2017-08-09 20:33:27 UTC
Created attachment 3930 [details]
logAttach

BUILD: 2.4 M2: rc3-9ed748a542b520c1cb763d981969233c0f5efd4e
ENVIRONMENT: Fedora 24 x86_64

STEPS TO REPRODUCE failure of test_arch_work_dir_and_export_source:
1. Download poky source
2. Prepare the build environment and add the lines to the conf/local.conf:INHERIT += "archiver"
ARCHIVER_MODE[src] = "original"
ARCHIVER_MODE[srpm] = "1"

3. Run "bitbake xcursor-transparent-theme".

EXPECTED OUTCOME: The tar, src.rpm packages should be in tmp/deploy/sources after build complete.

ACTUAL OUTCOME:
buildoptions.ArchiverTest.test_arch_work_dir_and_export_source - Testcase 926: FAILED

2017-08-08 23:24:30,737 - oe-selftest - INFO - ======================================================================
2017-08-08 23:24:30,737 - oe-selftest - INFO - FAIL [25.193s]: test_arch_work_dir_and_export_source (buildoptions.ArchiverTest)
2017-08-08 23:24:30,738 - oe-selftest - INFO - ----------------------------------------------------------------------
2017-08-08 23:24:30,738 - oe-selftest - INFO - Traceback (most recent call last):
  File "/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/meta/lib/oeqa/core/decorator/__init__.py", line 32, in wrapped_f
    return func(*args, **kwargs)
  File "/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/meta/lib/oeqa/selftest/cases/buildoptions.py", line 184, in test_arch_work_dir_and_export_source
    self.assertTrue((g.glob(src_file_glob) and g.glob(tar_file_glob)), "Couldn't find .src.rpm and .tar.gz files under %s/allarch*/xcursor*" % deploy_dir_src)
AssertionError: [] is not true : Couldn't find .src.rpm and .tar.gz files under /home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/build/tmp/deploy/sources/allarch*/xcursor*
==============================================================================
full log in attachment


STEPS TO REPRODUCE failure of test_layer_without_git_dir:

Test that layer git revisions are displayed and do not fail without git repository

1. bitbake -n ed
2. rename .git folder inside poky: mv .git .git_tmp
3. bitbake -n ed

EXPECTED OUTCOME: 1. Verify that the fatal error are not present:

fatal: Not a git repository (or any parent up to mount point /home)Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).

ACTUAL OUTCOME:

buildoptions.SanityOptionsTest.test_layer_without_git_dir - Testcase 1421: FAILED



2017-08-08 23:24:30,738 - oe-selftest - INFO - ======================================================================
2017-08-08 23:24:30,738 - oe-selftest - INFO - FAIL [20.930s]: test_layer_without_git_dir (buildoptions.SanityOptionsTest)
2017-08-08 23:24:30,738 - oe-selftest - INFO - ----------------------------------------------------------------------
2017-08-08 23:24:30,739 - oe-selftest - INFO - Traceback (most recent call last):
  File "/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/meta/lib/oeqa/core/decorator/__init__.py", line 32, in wrapped_f
    return func(*args, **kwargs)
  File "/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/meta/lib/oeqa/selftest/cases/buildoptions.py", line 148, in test_layer_without_git_dir
    ret = bitbake('-n %s' % test_recipe)
  File "/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/meta/lib/oeqa/utils/commands.py", line 213, in bitbake
    return runCmd(cmd, ignore_status, timeout, output_log=output_log, **options)
  File "/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/meta/lib/oeqa/utils/commands.py", line 191, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command 'bitbake  -n ed' returned non-zero exit status 1:
NOTE: Starting bitbake server...
ERROR: Unable to start bitbake server
ERROR: Last 10 lines of server log /home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/build/bitbake-cookerdaemon.log:
Running command ['setConfig', 'cmd', 'build']
Running command ['updateConfig', {'verbose': False, 'debug': 0, 'extra_assume_provided': [], 'abort': True, 'force': False, 'debug_domains': [], 'profile': False, 'dry_run': False, 'dump_signatures': [], 'prefile': [], 'postfile': [], 'invalidate_stamp': None, 'tracking': False, 'tryaltconfigs': False, 'server_timeout': None}, {'ERROR_REPORT_NAME': 'AutobuilderGDC', 'MODULEPATH': '/etc/scl/modulefiles:/usr/share/Modules/modulefiles:/etc/modulefiles:/usr/share/modulefiles', 'SHELL': '/usr/bin/bash', 'MACHINE_PUBLISH_DIR': 'machines', 'RELEASE_PUBLISH_DIR': '/srv/data/builds', 'ERROR_REPORT_EMAIL': 'autobuilder_gdc@intel.com', 'SOURCE_DL_DIR': '/tmp/yocto-autobuilder/downloads', 'IMAGE_FSTYPES': ' tar.gz', 'ERROR_REPORT_COLLECT': 'True', 'YOCTO_AB_CONFIG': '/srv/ab/autobuilder/buildset-config/yoctoAB.conf', 'SSTATE_DIR': '/srv/data/sstates', 'WEB_ROOT': '/var/www/', 'PUBLISH_BUILDS': 'False', 'no_proxy': 'localhost, 127.0.0.1, yctb.zpn.intel.com, 192.168.15.0/24', 'BUILD_HISTORY_DIR': '/tmp/yocto-autobuilder/buildhistory', '_': '/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/bitbake/bin/bitbake', 'WEB_URL': 'http://yctb01.zpn.intel.com:8010', 'XDG_DATA_DIRS': '/home/ab/.local/share/flatpak/exports/share/:/var/lib/flatpak/exports/share/:/usr/local/share/:/usr/share/', 'PERSISTDB_DIR': '/tmp/yocto-autobuilder/persistdb', 'HOME': '/home/ab', 'ERROR_REPORT_SERVER': 'errors.yoctoproject.org', 'LOGNAME': 'ab', 'PERFORMANCE_PUBLISH_DIR': '/srv/data/share/perf/', 'QA_MAIL_TO': 'yocto_ab_gdc_error@eclists.intel.com ', 'SHLVL': '3', 'DISPLAY': ':1', 'ADTQA_INST_PUBLISH_DIR': 'adt-installer-QA', 'LSB_SSTATE_DIR': '/tmp/yocto-autobuilder/lsb-sstate', 'BUILD_HISTORY_THROWAWAY_WHITELIST': "{'git://git.yoctoproject.org/poky':['master-next']}", 'X8664TC_PUBLISH_DIR': 'toolchain/x86_64', 'PERFORMANCE_SEND_EMAIL': 'True', 'TERM': 'xterm-256color', 'PUBLISH_SOURCE_MIRROR': 'False', 'BASH_FUNC_scl()': '() {  local CMD=$1;\n if [ "$CMD" = "load" -o "$CMD" = "unload" ]; then\n eval "module $@";\n else\n /usr/bin/scl "$@";\n fi\n}', 'USER': 'ab', 'MAINTAIN_PERSISTDB': 'True', 'LC_ALL': 'en_US.UTF-8', 'DAFT_WORKER_DEVICES_CFG': '/etc/daft/devices.cfg', 'BUILDLOG_TO_WIKI': 'False', 'CLEAN_SOURCE_DIR': 'False', 'QEMU_PUBLISH_DIR': '/machines/qemu', 'https_proxy': 'http://192.168.15.1:9111', 'BB_ENV_EXTRAWHITE': 'ALL_PROXY BBPATH_EXTRA BB_NO_NETWORK BB_NUMBER_THREADS BB_SETSCENE_ENFORCE BB_SRCREV_POLICY DISTRO FTPS_PROXY FTP_PROXY GIT_PROXY_COMMAND HTTPS_PROXY HTTP_PROXY MACHINE NO_PROXY PARALLEL_MAKE SCREENDIR SDKMACHINE SOCKS5_PASSWD SOCKS5_USER SSH_AGENT_PID SSH_AUTH_SOCK STAMPS_DIR TCLIBC TCMODE all_proxy ftp_proxy ftps_proxy http_proxy https_proxy no_proxy ', 'EMGD_DRIVER_DIR': '/tmp/yocto-autobuilder/emgd-driver', 'RESOLVED_TRIGGERED_HEAD': 'True', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'DEVKERNEL': 'linux-yocto-dev', 'QA_MAIL_CC': 'jose.perez.carranza@linux.intel.com', 'ADTREPO_PATH': '/tmp/adtrepo.yoctoproject.org/', 'PATH': '/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/scripts:/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/bitbake/bin:/srv/ab/autobuilder/bin:/srv/ab/autobuilder/yocto-autobuilder/scripts:/usr/lib64/ccache:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/ab/.local/bin:/home/ab/bin', 'BB_NUMBER_THREADS': '16', 'SOURCE_SSTATE_DIR': '/tmp/yocto-autobuilder/sstate', 'LOADEDMODULES': '', 'ADTREPO_GENERATE_DEV_INSTALLER': 'True', 'QEMU_USE_KVM': 'True', 'HISTSIZE': '1000', 'ADTREPO_URL': 'http://adtrepo.yoctoproject.org/', 'ADT_INST_PUBLISH_DIR': 'adt-installer', 'ADTREPO_POPULATE': 'False', 'socks_proxy': 'http://192.168.15.1:1080', 'RPM_PUBLISH_DIR': 'rpm', 'QA_MAIL_SIG': 'GDCSignature', 'MAKELEVEL': '1', 'HISTCONTROL': 'ignoredups', 'HOSTNAME': 'fedora24.yctb.zpn.intel.com', 'ADTREPO_DEV_PATH': '/tmp/adtrepo-dev/', 'PUBLISH_SSTATE': 'False', 'BUILD_HISTORY_REPO': 'file:////tmp/yocto-autobuilder/buildhistory-repo', 'MFLAGS': '', 'PERFORMANCE_MAIL_CC': 'jose.perez.carranza@linux.intel.com', 'IPK_PUBLISH_DIR': 'ipk', 'PYTHONPATH': '/srv/ab/autobuilder/lib/python2.7/site-packages/autobuilder/:/srv/ab/autobuilder/lib/python2.7/site-packages/:/srv/ab/autobuilder/lib/python2.7/site-packages/autobuilder/buildsteps:', 'OGIT_TRASH_NICE_LEVEL': '19', 'DL_DIR': '/srv/data/sources', 'OGIT_TRASH_DIR': '/home/ab//tmp//git/trash', 'ADTREPO_GENERATE_INSTALLER': 'False', 'PERFORMANCE_MAIL_SIG': 'GDCSignature', 'GIT_PROXY_COMMAND': '/usr/local/bin/git-proxy', 'DEB_PUBLISH_DIR': 'deb', 'BUILD_HISTORY_COLLECT': 'True', 'OGIT_MIRROR_DIR': '/home/ab//tmp//git/mirror', 'MAKEFLAGS': '', 'QA_MAIL_BCC': 'anibal.limon@linux.intel.com', 'BUILDDIR': '/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/build', 'PARALLEL_MAKE': '16', 'OPTIMIZED_GIT_CLONE': 'True', 'MAKE_TERMOUT': '/dev/pts/0', 'DEVKERNEL_MUT_REPO': "{'git://git.yoctoproject.org/poky-contrib':['stage/master_under_test', 'sgw/mut']}", 'DAFT_WORKER_WORKSPACE': '/home/ab/workspace', 'ADTREPO_DEV_URL': 'http://adtrepo-dev.yoctoproject.org/', 'WORKERBASEDIR': '/home/ab/autobuilder/yocto-worker', 'OGIT_TRASH_CRON_TIME': '0 0 * * *', 'LANG': 'en_US.UTF-8', 'BA_PUBLISH_DIR': 'build-appliance', 'BUILD_HISTORY_WEB_DIR': '/tmp/buildhistory-web', 'PWD': '/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/build', 'BUILD_PUBLISH_DIR': '/srv/data/builds', 'GEN_IMG_MD5': 'True', 'PERFORMANCE_MAIL_TO': 'humberto.ibarra.lopez@intel.com, jose.perez.carranza@intel.com, richard.purdie@intel.com, saul.wold@intel.com, markus.lehtonen@linux.intel.com, leonardo.sandoval.gonzalez@intel.com', 'BASH_FUNC_module()': '() {  eval `/usr/bin/modulecmd bash $*`\n}', 'MAIL': '/var/spool/mail/ab', 'PERFORMANCE_MAIL_BCC': 'anibal.limon@linux.intel.com', 'X86TC_PUBLISH_DIR': 'toolchain/i686', 'RESOLVE_TRIGGERED_HEAD': 'True', 'MODULESHOME': '/usr/share/Modules', 'MAKE_TERMERR': '/dev/pts/0', 'SOURCE_PUBLISH_DIR': '/srv/data/sources', 'http_proxy': 'http://192.168.15.1:9111', 'MARKED_RELEASE_DIR': 'releases', 'ADTREPO_DEV_POPULATE': 'True', 'BUILD_HISTORY_WHITELIST': "{'git://git.yoctoproject.org/poky':['master']}", 'SSTATE_PUBLISH_DIR': '/srv/data/sstates', 'BUILD_HISTORY_WEB': 'False', 'ftp_proxy': 'http://192.168.15.1:9111'}, ['/home/ab/autobuilder/yocto-worker/nightly-oe-selftest-fedora24/build/bitbake/bin/bitbake', 'core-image-sato']]
Running command ['buildTargets', ['core-image-sato'], 'build']
Connecting Client
Disconnecting Client
No timeout, exiting.
Exiting
Starting bitbake server pid 17152
Started bitbake server pid 17152
NOTE: Starting bitbake server...
===========================================================================================================================================================

Log attachment
Comment 1 Randy MacLeod 2017-08-10 15:17:34 UTC
Mostly for the reporter:
The commit referenced is relatively old so it may have been fixed already:

commit 9ed748a542b520c1cb763d981969233c0f5efd4e
Author:     Richard Purdie <richard.purdie@linuxfoundation.org>
AuthorDate: Wed Aug 2 06:37:01 2017 +0100
Commit:     Richard Purdie <richard.purdie@linuxfoundation.org>
CommitDate: Thu Aug 3 11:14:13 2017 +0100

    bitbake: daemonize: Always print any remaning UI events at exit
Comment 2 Alexander Kanavin 2017-08-23 17:31:26 UTC
Both testcases pass for me with the latest master. Can you check that it works for you as well?
Comment 3 oscar lopez arandas 2017-09-06 22:26:43 UTC
the test cases all passed in or-self test probe in master, is correct The commit referenced is relatively old. procede to put resolved a bug

COMMIT:5f6945f5031e1a4ca116cc1eccf4c2f9dc228547

BUILD: 2.4 M2: rc3
ENVIRONMENT: Fedora 24 x86_64

STEPS TO REPRODUCE failure of test_arch_work_dir_and_export_source:
1. Download poky source
2. Prepare the build environment and add the lines to the conf/local.conf:INHERIT += "archiver"
ARCHIVER_MODE[src] = "original"
ARCHIVER_MODE[srpm] = "1"

3. Run "bitbake xcursor-transparent-theme".

EXPECTED OUTCOME: The tar, src.rpm packages should be in tmp/deploy/sources after build complete.

ACTUAL OUTCOME:The tar, src.rpm packages should be in tmp/deploy/sources after build complete.
==============================================================================
2017-09-06 17:50:34,817 - oe-selftest - INFO - RESULTS - buildoptions.ArchiverTest.test_arch_work_dir_and_export_source - Testcase 926: PASSED
2017-09-06 17:50:34,819 - oe-selftest - INFO - RESULTS - buildoptions.SanityOptionsTest.test_layer_without_git_dir - Testcase 1421: PASSED
=============================================================================
Note: full-log in attachment
Comment 4 oscar lopez arandas 2017-09-06 22:27:48 UTC
Created attachment 3990 [details]
full_log