Bug 12852

Regression Result with 2.2.3.rc2 :

While doing regression, similar issue has been found, Please find the logs for the same :

12:53:18 - bitbake-worker - RESULTS - Testcase 1059:
Traceback (most recent call last):
File "/data/pankajsx/BSP_Test/2.2.3rc2_META_YOCTO_REGRESSION/poky/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f
return func(*args, **kwargs)
File "/data/pankajsx/BSP_Test/2.2.3rc2_META_YOCTO_REGRESSION/poky/meta/lib/oeqa/utils/decorators.py", line 97, in wrapped_f
return f(*args, **kwargs)
File "/data/pankajsx/BSP_Test/2.2.3rc2_META_YOCTO_REGRESSION/poky/meta/lib/oeqa/runtime/parselogs.py", line 313, in test_parselogs
self.assertEqual(errcount, 0, msg=self.msg)
AssertionError: 3 != 0 : Log: /data/pankajsx/BSP_Test/2.2.3rc2_META_YOCTO_REGRESSION/poky/genericx86-64-WIC/tmp/work/genericx86_64-poky-linux/core-image-lsb-sdk/1.0-r0/dmesg_output.log
-----------------------
Central error: [ 5.083753] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
***********************
[ 4.631207] Freeing unused kernel memory: 1272K (ffffffff81f0a000 - ffffffff82048000)
[ 4.638370] Write protecting the kernel read-only data: 14336k
[ 4.643973] Freeing unused kernel memory: 896K (ffff880001f20000 - ffff880002000000)
[ 4.651327] Freeing unused kernel memory: 484K (ffff880002387000 - ffff880002400000)
[ 4.839953] Adding 13429756k swap on /dev/sda3. Priority:-1 extents:1 across:13429756k SS
[ 4.933954] udevd[131]: starting version 3.2
[ 4.944868] random: udevd urandom read with 100 bits of entropy available
[ 4.976300] udevd[132]: starting eudev-3.2
[ 5.010072] EFI Variables Facility v0.08 2004-May-17
[ 5.050418] random: nonblocking pool is initialized
[ 5.083753] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
[ 5.164980] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC233: line_outs=1 (0x1b/0x0/0x0/0x0/0x0) type:speaker
[ 5.174292] snd_hda_codec_realtek hdaudioC0D0: speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[ 5.180912] snd_hda_codec_realtek hdaudioC0D0: hp_outs=1 (0x21/0x0/0x0/0x0/0x0)
[ 5.187210] snd_hda_codec_realtek hdaudioC0D0: mono: mono_out=0x0
[ 5.192263] snd_hda_codec_realtek hdaudioC0D0: dig-out=0x1e/0x0
[ 5.197154] snd_hda_codec_realtek hdaudioC0D0: inputs:
[ 5.237996] EXT4-fs (sda2): mounting ext3 file system using the ext4 subsystem
[ 5.240477] FAT-fs (sda1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[ 5.254807] EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: (null)
[ 5.281566] snd_hda_intel 0000:00:1f.3: Too many HDMI devices

***********************
Log: /data/pankajsx/BSP_Test/2.2.3rc2_META_YOCTO_REGRESSION/poky/genericx86-64-WIC/tmp/work/genericx86_64-poky-linux/core-image-lsb-sdk/1.0-r0/kern.log
-----------------------
Central error: Jul 12 13:04:17 genericx86-64 kernel: snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
***********************
Jul 12 13:04:17 genericx86-64 kernel: Freeing unused kernel memory: 1272K (ffffffff81f0a000 - ffffffff82048000)
Jul 12 13:04:17 genericx86-64 kernel: Write protecting the kernel read-only data: 14336k
Jul 12 13:04:17 genericx86-64 kernel: Freeing unused kernel memory: 896K (ffff880001f20000 - ffff880002000000)
Jul 12 13:04:17 genericx86-64 kernel: Freeing unused kernel memory: 484K (ffff880002387000 - ffff880002400000)
Jul 12 13:04:17 genericx86-64 kernel: Adding 13429756k swap on /dev/sda3. Priority:-1 extents:1 across:13429756k SS
Jul 12 13:04:17 genericx86-64 kernel: <30>udevd[131]: starting version 3.2
Jul 12 13:04:17 genericx86-64 kernel: random: udevd urandom read with 100 bits of entropy available
Jul 12 13:04:17 genericx86-64 kernel: <30>udevd[132]: starting eudev-3.2
Jul 12 13:04:17 genericx86-64 kernel: EFI Variables Facility v0.08 2004-May-17
Jul 12 13:04:17 genericx86-64 kernel: random: nonblocking pool is initialized
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC233: line_outs=1 (0x1b/0x0/0x0/0x0/0x0) type:speaker
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0: speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0: hp_outs=1 (0x21/0x0/0x0/0x0/0x0)
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0: mono: mono_out=0x0
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0: dig-out=0x1e/0x0
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0: inputs:
Jul 12 13:04:17 genericx86-64 kernel: EXT4-fs (sda2): mounting ext3 file system using the ext4 subsystem
Jul 12 13:04:17 genericx86-64 kernel: FAT-fs (sda1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
Jul 12 13:04:17 genericx86-64 kernel: EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: (null)
Jul 12 13:04:17 genericx86-64 kernel: snd_hda_intel 0000:00:1f.3: Too many HDMI devices

***********************
Log: /data/pankajsx/BSP_Test/2.2.3rc2_META_YOCTO_REGRESSION/poky/genericx86-64-WIC/tmp/work/genericx86_64-poky-linux/core-image-lsb-sdk/1.0-r0/dmesg
-----------------------
Central error: [ 5.083753] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
***********************
[ 4.631207] Freeing unused kernel memory: 1272K (ffffffff81f0a000 - ffffffff82048000)
[ 4.638370] Write protecting the kernel read-only data: 14336k
[ 4.643973] Freeing unused kernel memory: 896K (ffff880001f20000 - ffff880002000000)
[ 4.651327] Freeing unused kernel memory: 484K (ffff880002387000 - ffff880002400000)
[ 4.839953] Adding 13429756k swap on /dev/sda3. Priority:-1 extents:1 across:13429756k SS
[ 4.933954] udevd[131]: starting version 3.2
[ 4.944868] random: udevd urandom read with 100 bits of entropy available
[ 4.976300] udevd[132]: starting eudev-3.2
[ 5.010072] EFI Variables Facility v0.08 2004-May-17
[ 5.050418] random: nonblocking pool is initialized
[ 5.083753] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
[ 5.164980] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC233: line_outs=1 (0x1b/0x0/0x0/0x0/0x0) type:speaker
[ 5.174292] snd_hda_codec_realtek hdaudioC0D0: speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[ 5.180912] snd_hda_codec_realtek hdaudioC0D0: hp_outs=1 (0x21/0x0/0x0/0x0/0x0)
[ 5.187210] snd_hda_codec_realtek hdaudioC0D0: mono: mono_out=0x0
[ 5.192263] snd_hda_codec_realtek hdaudioC0D0: dig-out=0x1e/0x0
[ 5.197154] snd_hda_codec_realtek hdaudioC0D0: inputs:
[ 5.237996] EXT4-fs (sda2): mounting ext3 file system using the ext4 subsystem
[ 5.240477] FAT-fs (sda1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[ 5.254807] EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: (null)
[ 5.281566] snd_hda_intel 0000:00:1f.3: Too many HDMI devices

***********************
3 errors found in logs.

[Updated Steps]
Please follow below mentioned steps to reproduce : 

Step1 : Write the image to a bootable media (USB key, SD Card, etc.) using the dd command:
sudo dd if=core-image-lsb-sdk-genericx86-64.hddimg of=/dev/sdb
Attach the bootable device to the DUT
Turn the DUT on, and use its boot options to select the correct media for booting
Ensure the device has a network connection and a valid IP address
Step 2 : Clone poky repo $git clone git://git.yoctoproject.org/poky ( git checkout )
Step 3 : go to poky directory
Step 4 : Modify local.conf
INHERIT += "testimage"
TEST_TARGET = "simpleremote"
TEST_SERVER_IP = "10.221.183.11"
TEST_TARGET_IP = "10.221.70.157"
PARALLEL_MAKE = "-j 64"
BB_NUMBER_THREADS = "64"
IMAGE_FSTYPES = "wic" (For LSB Related test case)
DISTRO ?= "poky-lsb" (For LSB Related test case)

Step 5 : run "bitbake rpm busybox curl run-postinsts" and "bitbake package-index" under build directory
Step 6 : 
Download Artifacts
there are 2 links available from Public AutoBuilder to download images 
http://autobuilder.yoctoproject.org/pub/releases/
https://autobuilder.yocto.io/pub/releases/

Artifacts to be downloaded are: 
Real HW
under folder machines/<MACHINE_UNDER_TEST>

<IMAGE_TO_BE_TESTED>.hddimg
<IMAGE_TO_BE_TESTED>.wic
<IMAGE_TO_BE_TESTED>.wic.bmap
<IMAGE_TO_BE_TESTED>.manifest
<IMAGE_TO_BE_TESTED>.testdata.json
example of <IMAGE_TO_BE_TESTED> name core-image-lsb-sdk-genericx86-64 
Put downloaded images under poky/genericx86-WIC/tmp/deploy/images/MACHINE_UNDER_TEST/ directory
expample of MACHINE_UNDER_TEST=  genericx86-64, etc
step 7 : run "bitbake core-image-lsb-sdk -c testimage -v" under build directory

Can you provide a bit more information about this issue please?

Has the hardware used for this test changed from when the original 2.2 tests were run?

It sounds like the issue occurs with 2.2.3, was there a bug filed against 2.2.3 and was that resolved or not? Could you retest with the original 2.2 release images?

Our working theory is that the hardware may be newer than the release and this is confusing the kernel.

Is there any issue with the graphics or audio? We need to understand if the errors are just "noise" or whether there is a real problem with the hardware where functionality is affected.

Please find comments inline :

Can you provide a bit more information about this issue please?
These Auto BSP test cases are expected to Pass but these are failing with the error message "snd_hda_intel 0000:00:1f.3: failed to add i915 component master"

Please find comments inline :
Has the hardware used for this test changed from when the original 2.2 tests were run?
These test cases are failing in this release (2.2.4 rc1) on NUC 6 as well as previous release (2.2.3 rc2) on NUC 6 which I ran yesterday to check for regression.

It sounds like the issue occurs with 2.2.3, was there a bug filed against 2.2.3 and was that resolved or not? Could you retest with the original 2.2 release images?
The test case has been marked failed in 2.2.3 rc2 but no bug number has been attached.
Please mention the release number for the 'original' 2.2 release. I will perform a regression on that release 

Our working theory is that the hardware may be newer than the release and this is confusing the kernel.

Is there any issue with the graphics or audio? We need to understand if the errors are just "noise" or whether there is a real problem with the hardware where functionality is affected.
There is no test case for graphics and audio in this test suite. Let me know how to test the graphics and audio.

(In reply to comment #3)
> Can you provide a bit more information about this issue please?
> 
> Has the hardware used for this test changed from when the original 2.2 tests
> were run?
> 
> It sounds like the issue occurs with 2.2.3, was there a bug filed against
> 2.2.3 and was that resolved or not? Could you retest with the original 2.2
> release images?
> 
> Our working theory is that the hardware may be newer than the release and
> this is confusing the kernel.
> 
> Is there any issue with the graphics or audio? We need to understand if the
> errors are just "noise" or whether there is a real problem with the hardware
> where functionality is affected.

Hi Richard,

There was a hardware changed between 2.2.2 and 2.2.3 when QA transition from GDC to current PG team. During 2.2.3 this was failing but the team missed to fail bug for it.

Perhaps, regression shall be perform for 2.2.2 to find out if this issue was introduced after hardware changed.  

Hi Pankaj,

Could you please run regression for 2.2.2 using poky commit: 60402978fe3648bf560b3386c6e9dd661cdf2083 ? Thank you very much!

Regression Detail :
As Suggested by Ee Peng, regression performed on 2.2.2 release using poky commit: 60402978fe3648bf560b3386c6e9dd661cdf2083.

Hardware Used : NUC6

Observation : 
While doing automated testing, System gets rebooted and hanged at "Yocto Project" Logo before booting to OS.

Please find the logs for the same :

18:05:51 - bitbake-worker - RESULTS - Testcase 1059:
Traceback (most recent call last):
  File "/data/pankajsx/BSP_Test/2.2.2_regression/poky/meta/lib/oeqa/utils/decorators.py", line 109, in wrapped_f
    return func(*args, **kwargs)
  File "/data/pankajsx/BSP_Test/2.2.2_regression/poky/meta/lib/oeqa/utils/decorators.py", line 97, in wrapped_f
    return f(*args, **kwargs)
  File "/data/pankajsx/BSP_Test/2.2.2_regression/poky/meta/lib/oeqa/runtime/parselogs.py", line 313, in test_parselogs
    self.assertEqual(errcount, 0, msg=self.msg)
AssertionError: 3 != 0 : Log: /data/pankajsx/BSP_Test/2.2.2_regression/poky/genericx86-64_LSB/tmp/work/genericx86_64-poky-linux/core-image-lsb-sdk/1.0-r0/dmesg
-----------------------
Central error: [    7.540609] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
***********************
[    3.534911] input: HP HP USB 1000dpi Laser Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2.4/1-2.4:1.0/0003:03F0:1198.0002/input/input4
[    3.535867] hid-generic 0003:03F0:1198.0002: input: USB HID v2.00 Mouse [HP HP USB 1000dpi Laser Mouse] on usb-0000:00:14.0-2.4/input0
[    3.539551] hid-generic 0003:03F0:1198.0003: hiddev0: USB HID v2.00 Device [HP HP USB 1000dpi Laser Mouse] on usb-0000:00:14.0-2.4/input1
[    3.635176] EXT4-fs (loop0): couldn't mount as ext3 due to feature incompatibilities
[    3.635890] EXT4-fs (loop0): couldn't mount as ext2 due to feature incompatibilities
[    3.864754] random: nonblocking pool is initialized
[    6.645216] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[    7.220611] udevd[424]: starting version 3.2
[    7.245188] udevd[425]: starting eudev-3.2
[    7.290408] EFI Variables Facility v0.08 2004-May-17
[    7.540609] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
[    7.579956] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC233: line_outs=1 (0x1b/0x0/0x0/0x0/0x0) type:speaker
[    7.579960] snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    7.579962] snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x21/0x0/0x0/0x0/0x0)
[    7.579963] snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
[    7.579964] snd_hda_codec_realtek hdaudioC0D0:    dig-out=0x1e/0x0
[    7.579965] snd_hda_codec_realtek hdaudioC0D0:    inputs:
[    7.608575] EXT4-fs (loop0): re-mounted. Opts: (null)
[    7.623740] snd_hda_intel 0000:00:1f.3: Too many HDMI devices
[    7.623742] snd_hda_intel 0000:00:1f.3: Consider building the kernel with CONFIG_SND_DYNAMIC_MINORS=y

***********************
Log: /data/pankajsx/BSP_Test/2.2.2_regression/poky/genericx86-64_LSB/tmp/work/genericx86_64-poky-linux/core-image-lsb-sdk/1.0-r0/dmesg_output.log
-----------------------
Central error: [    7.540609] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
***********************
[    3.534911] input: HP HP USB 1000dpi Laser Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2.4/1-2.4:1.0/0003:03F0:1198.0002/input/input4
[    3.535867] hid-generic 0003:03F0:1198.0002: input: USB HID v2.00 Mouse [HP HP USB 1000dpi Laser Mouse] on usb-0000:00:14.0-2.4/input0
[    3.539551] hid-generic 0003:03F0:1198.0003: hiddev0: USB HID v2.00 Device [HP HP USB 1000dpi Laser Mouse] on usb-0000:00:14.0-2.4/input1
[    3.635176] EXT4-fs (loop0): couldn't mount as ext3 due to feature incompatibilities
[    3.635890] EXT4-fs (loop0): couldn't mount as ext2 due to feature incompatibilities
[    3.864754] random: nonblocking pool is initialized
[    6.645216] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[    7.220611] udevd[424]: starting version 3.2
[    7.245188] udevd[425]: starting eudev-3.2
[    7.290408] EFI Variables Facility v0.08 2004-May-17
[    7.540609] snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
[    7.579956] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC233: line_outs=1 (0x1b/0x0/0x0/0x0/0x0) type:speaker
[    7.579960] snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    7.579962] snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x21/0x0/0x0/0x0/0x0)
[    7.579963] snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
[    7.579964] snd_hda_codec_realtek hdaudioC0D0:    dig-out=0x1e/0x0
[    7.579965] snd_hda_codec_realtek hdaudioC0D0:    inputs:
[    7.608575] EXT4-fs (loop0): re-mounted. Opts: (null)
[    7.623740] snd_hda_intel 0000:00:1f.3: Too many HDMI devices
[    7.623742] snd_hda_intel 0000:00:1f.3: Consider building the kernel with CONFIG_SND_DYNAMIC_MINORS=y
[    8.679864] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready

***********************
Log: /data/pankajsx/BSP_Test/2.2.2_regression/poky/genericx86-64_LSB/tmp/work/genericx86_64-poky-linux/core-image-lsb-sdk/1.0-r0/kern.log
-----------------------
Central error: Jul 17 18:15:58 genericx86-64 kernel: snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
***********************
Jul 17 18:15:58 genericx86-64 kernel: input: HP HP USB 1000dpi Laser Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-2/1-2.4/1-2.4:1.0/0003:03F0:1198.0002/input/input4
Jul 17 18:15:58 genericx86-64 kernel: hid-generic 0003:03F0:1198.0002: input: USB HID v2.00 Mouse [HP HP USB 1000dpi Laser Mouse] on usb-0000:00:14.0-2.4/input0
Jul 17 18:15:58 genericx86-64 kernel: hid-generic 0003:03F0:1198.0003: hiddev0: USB HID v2.00 Device [HP HP USB 1000dpi Laser Mouse] on usb-0000:00:14.0-2.4/input1
Jul 17 18:15:58 genericx86-64 kernel: EXT4-fs (loop0): couldn't mount as ext3 due to feature incompatibilities
Jul 17 18:15:58 genericx86-64 kernel: EXT4-fs (loop0): couldn't mount as ext2 due to feature incompatibilities
Jul 17 18:15:58 genericx86-64 kernel: random: nonblocking pool is initialized
Jul 17 18:15:58 genericx86-64 kernel: EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
Jul 17 18:15:58 genericx86-64 kernel: <30>udevd[424]: starting version 3.2
Jul 17 18:15:58 genericx86-64 kernel: <30>udevd[425]: starting eudev-3.2
Jul 17 18:15:58 genericx86-64 kernel: EFI Variables Facility v0.08 2004-May-17
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_intel 0000:00:1f.3: failed to add i915 component master (-19)
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC233: line_outs=1 (0x1b/0x0/0x0/0x0/0x0) type:speaker
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x21/0x0/0x0/0x0/0x0)
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0:    dig-out=0x1e/0x0
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_codec_realtek hdaudioC0D0:    inputs:
Jul 17 18:15:58 genericx86-64 kernel: EXT4-fs (loop0): re-mounted. Opts: (null)
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_intel 0000:00:1f.3: Too many HDMI devices
Jul 17 18:15:58 genericx86-64 kernel: snd_hda_intel 0000:00:1f.3: Consider building the kernel with CONFIG_SND_DYNAMIC_MINORS=y
Jul 17 18:15:58 genericx86-64 kernel: IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready

***********************
3 errors found in logs.

Changing status to NEW as required information has been provided and assigning to bruce.ashfield@windriver.com.

I don't plan on addressing this issue for any future release.

not fixing at this time