| Summary: | qemu CPU starvation triggers rcu_preempt stall detection | ||
|---|---|---|---|
| Product: | [QA/Testing] Functional (self) Testing | Reporter: | Alexandre Belloni <alexandre.belloni> |
| Component: | oe-selftest | Assignee: | Richard Purdie <richard.purdie> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | normal | ||
| Priority: | Medium+ | CC: | chee.yang.lee, jon.mason, kory.maincent, randy.macleod, richard.purdie |
| Version: | 3.3 | ||
| Target Milestone: | 3.4 M2 | ||
| Hardware: | x86 | ||
| OS: | Multiple | ||
| See Also: | https://bugzilla.yoctoproject.org/show_bug.cgi?id=16349 | ||
| Whiteboard: | AB-INT | ||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | No (bug/feature does not impact docs) | |
|
Description
Alexandre Belloni
2021-03-02 00:24:04 UTC
*** Bug 14291 has been marked as a duplicate of this bug. *** https://autobuilder.yoctoproject.org/typhoon/#/builders/42/builds/3186/steps/13/logs/stdio The stack trace of python calls that resulted in this exception/failure was: File: 'exec_python_func() autogenerated', lineno: 2, function: <module> 0001: *** 0002:do_testimage(d) 0003: File: '/home/pokybuild/yocto-worker/qemuarm64/build/meta/classes/testimage.bbclass', lineno: 131, function: do_testimage 0127: netstat -an 0128:} 0129: 0130:python do_testimage() { *** 0131: testimage_main(d) 0132:} 0133: 0134:addtask testimage 0135:do_testimage[nostamp] = "1" File: '/home/pokybuild/yocto-worker/qemuarm64/build/meta/classes/testimage.bbclass', lineno: 375, function: testimage_main 0371: orig_sigterm_handler = signal.signal(signal.SIGTERM, sigterm_exception) 0372: try: 0373: # We need to check if runqemu ends unexpectedly 0374: # or if the worker send us a SIGTERM *** 0375: tc.target.start(params=d.getVar("TEST_QEMUPARAMS"), runqemuparams=d.getVar("TEST_RUNQEMUPARAMS")) 0376: import threading 0377: try: 0378: threading.Timer(int(d.getVar("TEST_OVERALL_TIMEOUT")), handle_test_timeout, (int(d.getVar("TEST_OVERALL_TIMEOUT")),)).start() 0379: except ValueError: File: '/home/pokybuild/yocto-worker/qemuarm64/build/meta/lib/oeqa/core/target/qemu.py', lineno: 71, function: start 0067: if self.runner.server_ip: 0068: self.server_ip = self.runner.server_ip 0069: else: 0070: self.stop() *** 0071: raise RuntimeError("FAILED to start qemu - check the task log and the boot log") 0072: 0073: def stop(self): 0074: self.runner.stop() Exception: RuntimeError: FAILED to start qemu - check the task log and the boot log https://autobuilder.yoctoproject.org/typhoon/#/builders/60/builds/3330 qemumips master on debian8-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/3402/steps/19/logs/stdio qemuarm master on ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/42/builds/3408/steps/13/logs/stdio ubuntu1804-ty-3 qemuarm64 https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/2123/steps/14/logs/stdio ubuntu1804-ty-1 happen during selftest https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/2120/steps/14/logs/stdio ubuntu1804-ty-3 oe-selftest-ubuntu https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/3441/steps/13/logs/stdio ubuntu1804-ty-2 qemuarm https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/2149/steps/14/logs/stdio oe-selftest-ubuntu ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/3454/steps/13/logs/stdio qemuarm ubuntu1804-ty-1 Was locked up prior to being canceled More instances: https://autobuilder.yoctoproject.org/typhoon/#/builders/42/builds/3453/steps/13/logs/stdio https://autobuilder.yoctoproject.org/typhoon/#/builders/45/builds/3463/steps/13/logs/stdio https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2118/steps/12/logs/stdio qemux86-64-ptest ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/2160/steps/14/logs/stdio oe-selftest-ubuntu ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/3493/steps/13/logs/stdio qemuarm fedora31-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/56/builds/1465/steps/14/logs/stdio oe-selftest ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/40/builds/3471/steps/12/logs/stdio no-x11 ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/44/builds/3543/steps/18/logs/stdio multilib ubuntu1804-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/2208/steps/14/logs/stdio oe-selftest-ubuntu ubuntu1804-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/47/builds/3558/steps/12/logs/stdio qemuarm-oecore ubuntu1804-ty-3 This log has the top output https://autobuilder.yoctoproject.org/typhoon/#/builders/73/builds/3541/steps/13/logs/stdio qemux86-64 ubuntu1804-ty-1 Note that this log would indicate that bug 14399, bug 14352 and bug 14002 are related. https://autobuilder.yoctoproject.org/typhoon/#/builders/73/builds/3540/steps/13/logs/stdio qemux86-64 ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/53/builds/3574/steps/13/logs/stdio qemuarm ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/2229/steps/14/logs/stdio oe-selftest-ubuntu ubuntu1804-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/59/builds/3555/steps/19/logs/stdio qemux86 ubuntu1804-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/45/builds/3576/steps/12/logs/stdio musl-qemux86-64 ubuntu1804-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/2242/steps/14/logs/stdio oe-selftest-ubuntu ubuntu1804-ty-2 https://autobuilder.yoctoproject.org/typhoon/#/builders/56/builds/1488/steps/14/logs/stdio oe-selftest ubuntu1804-ty-1 Stalls should no longer cause the hang: http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=1f802cdf857475eefb9f3ae5032a6f1ce3e01d97 |