Bug 11325

Summary: nightly-mips exception running ESDK sanity tests on master-next
Product: [Yocto Project Subprojects] eSDK Reporter: California Sullivan <california.l.sullivan>
Component: eSDKAssignee: Paul Eggleton <bluelightning>
Status: RESOLVED DUPLICATE QA Contact:
Severity: normal    
Priority: Undecided CC: leonardo.sandoval.gonzalez
Version: unspecified   
Target Milestone: ---   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
ESDK Sanity Tests log
none
CreateAutoConf log none

Description California Sullivan 2017-04-10 19:56:30 UTC
Created attachment 3700 [details]
ESDK Sanity Tests log

ERROR: core-image-minimal-1.0-r0 do_testsdkext: Error executing a python function in exec_python_func() autogenerated:

The stack trace of python calls that resulted in this exception/failure was:
File: 'exec_python_func() autogenerated', lineno: 2, function: <module>
     0001:
 *** 0002:do_testsdkext(d)
     0003:
File: '/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-mips/build/meta/classes/testsdk.bbclass', lineno: 188, function: do_testsdkext
     0184:
     0185:testsdkext_main[vardepsexclude] =+ "BB_ORIGENV"
     0186:
     0187:python do_testsdkext() {
 *** 0188:    testsdkext_main(d)
     0189:}
     0190:addtask testsdkext
     0191:do_testsdkext[nostamp] = "1"
     0192:
File: '/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-mips/build/meta/classes/testsdk.bbclass', lineno: 171, function: testsdkext_main
     0167:        except Exception as e:
     0168:            import traceback
     0169:            bb.fatal("Loading tests failed:\n%s" % traceback.format_exc())
     0170:
 *** 0171:        result = tc.runTests()
     0172:
     0173:        component = "%s %s" % (pn, OESDKExtTestContextExecutor.name)
     0174:        context_msg = "%s:%s" % (os.path.basename(tcname), os.path.basename(sdk_env))
     0175:
File: '/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-mips/build/meta/lib/oeqa/core/context.py', lineno: 59, function: runTests
     0055:        streamLogger = self.streamLoggerClass(self.logger)
     0056:        self.runner = self.runnerClass(self, stream=streamLogger, verbosity=2)
     0057:
     0058:        self._run_start_time = time.time()
 *** 0059:        result = self.runner.run(self.suites)
     0060:        self._run_end_time = time.time()
     0061:
     0062:        return result
     0063:
File: '/usr/lib/python3.5/site-packages/xmlrunner/runner.py', lineno: 112, function: run
     0108:
     0109:            # Generate reports
     0110:            self.stream.writeln()
     0111:            self.stream.writeln('Generating XML reports...')
 *** 0112:            result.generate_reports(self)
     0113:        finally:
     0114:            pass
     0115:
     0116:        return result
File: '/usr/lib/python3.5/site-packages/xmlrunner/result.py', lineno: 451, function: generate_reports
     0447:        outputHandledAsString = \
     0448:            isinstance(test_runner.output, six.string_types)
     0449:
     0450:        if (outputHandledAsString and not os.path.exists(test_runner.output)):
 *** 0451:            os.makedirs(test_runner.output)
     0452:
     0453:        if not outputHandledAsString:
     0454:            doc = Document()
     0455:            testsuite = doc.createElement('testsuites')
File: '/usr/lib64/python3.5/os.py', lineno: 241, function: makedirs
     0237:            cdir = bytes(curdir, 'ASCII')
     0238:        if tail == cdir:           # xxx/newdir/. exists if xxx/newdir exists
     0239:            return
     0240:    try:
 *** 0241:        mkdir(name, mode)
     0242:    except OSError:
     0243:        # Cannot rely on checking for EEXIST, since the operating system
     0244:        # could give priority to other errors like EACCES or EROFS
     0245:        if not exist_ok or not path.isdir(name):
Exception: FileExistsError: [Errno 17] File exists: '/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-mips/build/build/TestResults_20170409130114'
Comment 1 California Sullivan 2017-04-10 19:58:37 UTC
Created attachment 3701 [details]
CreateAutoConf log

Looks like this step had some failures as well:

Initialized empty Git repository in /srv/www/vhosts/autobuilder.yoctoproject.org/buildhistory/poky/master-next/nightly-mips/.git/
Host key verification failed.
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
Host key verification failed.
fatal: Could not read from remote repository.
Comment 2 Jose Perez C 2017-04-10 20:02:47 UTC
Isn't this a duplicated from bug 11318 ?
Comment 3 California Sullivan 2017-04-10 20:06:58 UTC
Indeed it is... my bad.

*** This bug has been marked as a duplicate of bug 11318 ***
Comment 4 Leonardo Sandoval Gonzalez 2017-04-10 21:16:25 UTC
Cal,
can you paste the AB link where you obtained the log data? bug 11318 tracks [1] but in that build the createautoconf steps are green so I believe the  URI that you used is different.


[1] https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107/steps/Running%20ESDK%20Sanity%20Tests/logs/stdio
Comment 5 California Sullivan 2017-04-10 21:30:16 UTC
ESDK Sanity tests log:

https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107/steps/Running%20ESDK%20Sanity%20Tests/logs/stdio

CreateAutoConf log:

https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107/steps/CreateAutoConf/logs/stdio

Looking at the autobuilder page, the step is indeed green, despite the error:

https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107

Also, it looks like I included the wrong CreateAutoConf step. There are three and I should have grabbed this one:

https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107/steps/CreateAutoConf_3/logs/stdio

I'll keep this in mind in the future while I'm on SWAT duty. At least I may have discovered an autobuilder bug.
Comment 6 Leonardo Sandoval Gonzalez 2017-04-11 17:02:13 UTC
(In reply to comment #5)
> ESDK Sanity tests log:
> 
> https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107/
> steps/Running%20ESDK%20Sanity%20Tests/logs/stdio
> 
Ok, so indeed this is a duplicated bug.

> CreateAutoConf log:
> 
> https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107/
> steps/CreateAutoConf/logs/stdio
> 
> Looking at the autobuilder page, the step is indeed green, despite the error:
> 
> https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107
> 
> Also, it looks like I included the wrong CreateAutoConf step. There are
> three and I should have grabbed this one:

Seems that the CreateAutoConf issue is unrelated to the problem reported on comment 1. Also, the latter was not found on a local AB (centos) leading to a problem either at the worker or a race condition happening at the bitbake task.

> 
> https://autobuilder.yoctoproject.org/main/builders/nightly-mips/builds/1107/
> steps/CreateAutoConf_3/logs/stdio
> 

I do not see the error in the above URL; the problem is coming on the main CreateAutoConf, the one without any postfix.

> I'll keep this in mind in the future while I'm on SWAT duty. At least I may
> have discovered an autobuilder bug.

I think so. I will file a bug, so it does not get lost on comments.