Bug 15042 - AB-INT: oe-selftest hangs
Summary: AB-INT: oe-selftest hangs
Status: RESOLVED FIXED
Alias: None
Product: Functional (self) Testing
Classification: QA/Testing
Component: oe-selftest (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Undecided normal
Target Milestone: ---
Assignee: Unassigned
QA Contact:
URL:
Whiteboard: AB-INT
Depends on:
Blocks:
 
Reported: 2023-02-23 14:42 UTC by Alexandre Belloni
Modified: 2023-02-23 15:46 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandre Belloni 2023-02-23 14:42:24 UTC 
From RP:

https://autobuilder.yoctoproject.org/typhoon/#/builders/86/builds/4815

Looking at the bitbake-cookerdaemon.log, we see:

to-worker/oe-selftest-fedora/build/build-st-1756321', 'OLDPWD': '/home/pokybuild/yocto-worker/oe-selftest-fedora/build'}, ['/home/pokybuild/yocto-worker/oe-selfte
st-fedora/build/bitbake/bin/bitbake', '-e']]
1758267 15:58:48.269660 Command Completed (socket: True)
1758267 15:58:48.269853 Running command ['getVariable', 'BBINCLUDELOGS']
Exception in thread Thread-1 (idle_thread):
Traceback (most recent call last):
  File "/usr/lib64/python3.10/threading.py", line 1016, in _bootstrap_inner
    self.run()
  File "/usr/lib64/python3.10/threading.py", line 953, in run
    self._target(*self._args, **self._kwargs)
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/lib/bb/server/process.py", line 408, in idle_thread
    self.cooker.process_inotify_updates()
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/lib/bb/cooker.py", line 256, in process_inotify_updates
    n.read_events()
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/lib/pyinotify.py", line 1207, in read_events
    if fcntl.ioctl(self._fd, termios.FIONREAD, buf_, 1) == -1:
OSError: [Errno 9] Bad file descriptor
1758267 15:58:48.694198 Command Completed (socket: True)
1758267 15:58:48.694547 Running command ['getVariable', 'BBINCLUDELOGS_LINES']
1758267 15:58:48.694993 Command Completed (socket: True)
1758267 15:58:48.695184 Running command ['getSetVariable', 'BB_CONSOLELOG']

and then pings are keeping things alive but it looks like the idle thread has crashed. I saved the log into ~/saved.

(gdb) py-bt
Traceback (most recent call first):
  <built-in method select of module object at remote 0x7fa4fe92dad0>
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/lib/bb/server/process.py", line 481, in idle_commands
    return select.select(fds,[],[],nextsleep)[0]
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/lib/bb/server/process.py", line 318, in main
    ready = self.idle_commands(.1, fds)
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/lib/bb/server/process.py", line 153, in run
    ret = self.main()
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/lib/bb/server/process.py", line 655, in execServer
    server.run()
  File "/home/pokybuild/yocto-worker/oe-selftest-fedora/build/bitbake/bin/bitbake-server", line 54, in <module>
    bb.server.process.execServer(lockfd, readypipeinfd, lockname, sockname, timeout, xmlrpcinterface, profile)
(gdb) info threads
  Id   Target Id                                    Frame
* 1    Thread 0x7fa4ff411740 (LWP 1758267) "Cooker" 0x00007fa4fed0841c in select () from /lib64/libc.so.6

which shows the idle thread is missing due to the exception.
Comment 1 Alexandre Belloni 2023-02-23 14:47:56 UTC 
https://autobuilder.yoctoproject.org/typhoon/#builders/86/builds/4825/steps/14/logs/stdio

oe-selftest-fedora fedora36-ty-3

Was also hung, also terminated by RP