13988 2020-07-20 08:36:19 +0000 Intermittent kernel apic boot panic on qemux86-64 2020-12-10 16:03:11 +0000 1 1 7 Build System, Metadata & Runtime OE-Core kernel 3.2 x86 Multiple RESOLVED WORKSFORME AB-INT Medium normal 3.3 M1 1 richard.purdie bruce.ashfield anuj.mittal randy.macleod sakib.sajal tim.orling tom.zanussi --- --- No (bug/feature does not impact docs) oldest_to_newest 87799 0 richard.purdie 2020-07-20 08:36:19 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/73/builds/2194/steps/8/logs/step3d runqemu - INFO - Network configuration: ip=192.168.7.16::192.168.7.15:255.255.255.0 runqemu - INFO - Running /home/pokybuild/yocto-worker/qemux86-64/build/build-st-3389646/tmp/work/x86_64-linux/qemu-helper-native/1.0-r1/recipe-sysroot-native/usr/bin/qemu-system-x86_64 -device virtio-net-pci,netdev=net0,mac=52:54:00:12:34:10 -netdev tap,id=net0,ifname=tap7,script=no,downscript=no -drive file=/home/pokybuild/yocto-worker/qemux86-64/build/build-st-3389646/tmp/deploy/images/qemux86-64/core-image-minimal-qemux86-64-20200720124813.rootfs.ext4,if=virtio,format=raw -usb -device usb-tablet -object rng-random,filename=/dev/urandom,id=rng0 -device virtio-rng-pci,rng=rng0 -nographic -cpu core2duo -m 256 -serial tcp:127.0.0.1:51487 -serial tcp:127.0.0.1:50261 -pidfile /home/pokybuild/yocto-worker/qemux86-64/build/build-st-3389646/pidfile_3389646 -kernel /home/pokybuild/yocto-worker/qemux86-64/build/build-st-3389646/tmp/deploy/images/qemux86-64/bzImage--5.4.51+git0+caafbdfe38_fed60f1c8e-r0-qemux86-64-20200720110023.bin -append 'root=/dev/vda rw console=ttyS0 mem=256M ip=192.168.7.16::192.168.7.15:255.255.255.0 oprofile.timer=1 console=tty1 console=ttyS0,115200n8 printk.time=1' QEMU 5.0.0 monitor - type 'help' for more information (qemu) DEBUG: Waiting at most 1000 seconds for login banner (07/20/20 12:51:54) DEBUG: Connection from 127.0.0.1:39968 WARNING: Target didn't reach login banner in 1000 seconds (07/20/20 13:08:35) WARNING: Last 25 lines of text: [ 2.211277] APIC: Switch to symmetric I/O mode setup [ 2.221512] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 2.238273] ..MP-BIOS bug: 8254 timer not connected to IO-APIC [ 2.238999] ...trying to set up timer (IRQ0) through the 8259A ... [ 2.239280] ..... (found apic 0 pin 2) ... [ 2.255186] ....... failed. [ 2.255777] ...trying to set up timer as Virtual Wire IRQ... [ 2.272077] ..... failed. [ 2.272410] ...trying to set up timer as ExtINT IRQ... [ 4.252956] ..... failed :(. [ 4.253728] Kernel panic - not syncing: IO-APIC + timer doesn't work! Boot with apic=debug and send a report. Then try booting with the 'noapic' option. [ 4.254666] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.51-yocto-standard #1 [ 4.255351] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-0-gf21b5a4aeb02-prebuilt.qemu.org 04/01/2014 [ 4.256004] Call Trace: [ 4.257707] dump_stack+0x57/0x7a [ 4.258012] panic+0x102/0x2b1 [ 4.258226] setup_IO_APIC+0x802/0x841 [ 4.258430] ? clear_IO_APIC+0x39/0x60 [ 4.258663] apic_intr_mode_init+0xf5/0xf7 [ 4.258876] x86_late_time_init+0x24/0x2b [ 4.259080] start_kernel+0x41f/0x4cf [ 4.259282] x86_64_start_reservations+0x24/0x26 [ 4.259505] x86_64_start_kernel+0x70/0x74 [ 4.259736] secondary_startup_64+0xa4/0xb0 [ 4.261308] ---[ end Kernel panic - not syncing: IO-APIC + timer doesn't work! Boot with apic=debug and send a report. Then try booting with the 'noapic' option. ]--- WARNING: Check full boot log: /home/pokybuild/yocto-worker/qemux86-64/build/build-st-3389646/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/testimage/qemu_boot_log.20200720125152 WARNING: Qemu ended unexpectedly, dump data from host is in /home/pokybuild/yocto-worker/qemux86-64/build/build-st-3389646/tmp/log/runtime-hostdump/202007201308_qemu DEBUG: Stopping logging thread DEBUG: Stop event received DEBUG: Tearing down logging thread DEBUG: Sending SIGTERM to runqemu DEBUG: Sending SIGTERM to runqemu 87800 1 richard.purdie 2020-07-20 08:36:53 +0000 Bruce: FWIW I just merged the recent kernel changes as those had a green build previously 87801 2 4704 richard.purdie 2020-07-20 08:43:03 +0000 Created attachment 4704 Boot log from failed qemu 87802 3 richard.purdie 2020-07-20 08:44:18 +0000 Build saved as centos8-ty-2:/home/pokybuild/saved-build-20200720 in case we need it for debugging 87806 4 bruce.ashfield 2020-07-20 11:41:27 +0000 Did this only start popping up after the v5.4.51 merge ? There's only one kernel commit that even looks remotely close: Author: Marc Zyngier <maz@kernel.org> Date: Sun Jun 21 14:43:15 2020 +0100 irqchip/gic: Atomically update affinity commit 005c34ae4b44f085120d7f371121ec7ded677761 upstream. The GIC driver uses a RMW sequence to update the affinity, and relies on the gic_lock_irqsave/gic_unlock_irqrestore sequences to update it atomically. But these sequences only expand into anything meaningful if the BL_SWITCHER option is selected, which almost never happens. It also turns out that using a RMW and locks is just as silly, as the GIC distributor supports byte accesses for the GICD_TARGETRn registers, which when used make the update atomic by definition. Drop the terminally broken code and replace it by a byte write. Fixes: 04c8b0f82c7d ("irqchip/gic: Make locking a BL_SWITCHER only feature") Cc: stable@vger.kernel.org Signed-off-by: Marc Zyngier <maz@kernel.org> Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org> I'm double checking the config changes as well, but I don't recall anything relevant. 87810 5 richard.purdie 2020-07-21 01:44:59 +0000 (In reply to comment #4) > Did this only start popping up after the v5.4.51 merge ? Yes, although whether its coincidence or not, unknown... 87824 6 randy.macleod 2020-07-23 07:39:56 +0000 Assigned to Bruce, Sakib please try to reproduce when you have time. 88625 7 randy.macleod 2020-11-19 15:47:47 +0000 Lowered to medium, raise to M+ if seen again. 88752 8 randy.macleod 2020-12-10 16:03:11 +0000 This bug hasn't been seen for months. Reopen if it's reproduced. IO priority adjustments may be preventing us from seeing this. 4704 2020-07-20 08:43:03 +0000 2020-07-20 08:43:03 +0000 Boot log from failed qemu qemu_boot_log.20200720125152 application/octet-stream 7927 richard.purdie Y1s/N2xbMkpbMG1TZWFCSU9TICh2ZXJzaW9uIHJlbC0xLjEzLjAtMC1nZjIxYjVhNGFlYjAyLXBy ZWJ1aWx0LnFlbXUub3JnKQ0KCgppUFhFIChodHRwOi8vaXB4ZS5vcmcpIDAwOjAzLjAgQ0EwMCBQ Q0kyLjEwIFBuUCBQTU0rMEZGOTA2ODArMEZFRjA2ODAgQ0EwMA0KUHJlc3MgQ3RybC1CIHRvIGNv bmZpZ3VyZSBpUFhFIChQQ0kgMDA6MDMuMCkuLi4NICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIA0KCgpC b290aW5nIGZyb20gUk9NLi5jWz83bFsySlsgICAgMC4wMDAwMDBdIExpbnV4IHZlcnNpb24gNS40 LjUxLXlvY3RvLXN0YW5kYXJkIChvZS11c2VyQG9lLWhvc3QpIChnY2MgdmVyc2lvbiAxMC4xLjAg KEdDQykpICMxIFNNUCBQUkVFTVBUIE1vbiBKdWwgMTMgMTc6NDI6NTAgVVRDIDIwMjANClsgICAg MC4wMDAwMDBdIENvbW1hbmQgbGluZTogcm9vdD0vZGV2L3ZkYSBydyAgY29uc29sZT10dHlTMCBt ZW09MjU2TSBpcD0xOTIuMTY4LjcuMTY6OjE5Mi4xNjguNy4xNToyNTUuMjU1LjI1NS4wIG9wcm9m aWxlLnRpbWVyPTEgY29uc29sZT10dHkxIGNvbnNvbGU9dHR5UzAsMTE1MjAwbjggcHJpbnRrLnRp bWU9MQ0KWyAgICAwLjAwMDAwMF0geDg2L2ZwdTogeDg3IEZQVSB3aWxsIHVzZSBGWFNBVkUNClsg ICAgMC4wMDAwMDBdIEJJT1MtcHJvdmlkZWQgcGh5c2ljYWwgUkFNIG1hcDoNClsgICAgMC4wMDAw MDBdIEJJT1MtZTgyMDogW21lbSAweDAwMDAwMDAwMDAwMDAwMDAtMHgwMDAwMDAwMDAwMDlmYmZm XSB1c2FibGUNClsgICAgMC4wMDAwMDBdIEJJT1MtZTgyMDogW21lbSAweDAwMDAwMDAwMDAwOWZj MDAtMHgwMDAwMDAwMDAwMDlmZmZmXSByZXNlcnZlZA0KWyAgICAwLjAwMDAwMF0gQklPUy1lODIw OiBbbWVtIDB4MDAwMDAwMDAwMDBmMDAwMC0weDAwMDAwMDAwMDAwZmZmZmZdIHJlc2VydmVkDQpb ICAgIDAuMDAwMDAwXSBCSU9TLWU4MjA6IFttZW0gMHgwMDAwMDAwMDAwMTAwMDAwLTB4MDAwMDAw MDAwZmZkYWZmZl0gdXNhYmxlDQpbICAgIDAuMDAwMDAwXSBCSU9TLWU4MjA6IFttZW0gMHgwMDAw MDAwMDBmZmRiMDAwLTB4MDAwMDAwMDAwZmZmZmZmZl0gcmVzZXJ2ZWQNClsgICAgMC4wMDAwMDBd IEJJT1MtZTgyMDogW21lbSAweDAwMDAwMDAwZmZmYzAwMDAtMHgwMDAwMDAwMGZmZmZmZmZmXSBy ZXNlcnZlZA0KWyAgICAwLjAwMDAwMF0gTlggKEV4ZWN1dGUgRGlzYWJsZSkgcHJvdGVjdGlvbjog YWN0aXZlDQpbICAgIDAuMDAwMDAwXSB1c2VyLWRlZmluZWQgcGh5c2ljYWwgUkFNIG1hcDoNClsg ICAgMC4wMDAwMDBdIHVzZXI6IFttZW0gMHgwMDAwMDAwMDAwMDAwMDAwLTB4MDAwMDAwMDAwMDA5 ZmJmZl0gdXNhYmxlDQpbICAgIDAuMDAwMDAwXSB1c2VyOiBbbWVtIDB4MDAwMDAwMDAwMDA5ZmMw MC0weDAwMDAwMDAwMDAwOWZmZmZdIHJlc2VydmVkDQpbICAgIDAuMDAwMDAwXSB1c2VyOiBbbWVt IDB4MDAwMDAwMDAwMDBmMDAwMC0weDAwMDAwMDAwMDAwZmZmZmZdIHJlc2VydmVkDQpbICAgIDAu MDAwMDAwXSB1c2VyOiBbbWVtIDB4MDAwMDAwMDAwMDEwMDAwMC0weDAwMDAwMDAwMGZmZGFmZmZd IHVzYWJsZQ0KWyAgICAwLjAwMDAwMF0gdXNlcjogW21lbSAweDAwMDAwMDAwMGZmZGIwMDAtMHgw MDAwMDAwMDBmZmZmZmZmXSByZXNlcnZlZA0KWyAgICAwLjAwMDAwMF0gdXNlcjogW21lbSAweDAw MDAwMDAwZmZmYzAwMDAtMHgwMDAwMDAwMGZmZmZmZmZmXSByZXNlcnZlZA0KWyAgICAwLjAwMDAw MF0gU01CSU9TIDIuOCBwcmVzZW50Lg0KWyAgICAwLjAwMDAwMF0gRE1JOiBRRU1VIFN0YW5kYXJk IFBDIChpNDQwRlggKyBQSUlYLCAxOTk2KSwgQklPUyByZWwtMS4xMy4wLTAtZ2YyMWI1YTRhZWIw Mi1wcmVidWlsdC5xZW11Lm9yZyAwNC8wMS8yMDE0DQpbICAgIDAuMDAwMDAwXSB0c2M6IEZhc3Qg VFNDIGNhbGlicmF0aW9uIHVzaW5nIFBJVA0KWyAgICAwLjAwMDAwMF0gdHNjOiBEZXRlY3RlZCAy NjAwLjAxNyBNSHogcHJvY2Vzc29yDQpbICAgIDAuMDA5MDg0XSBsYXN0X3BmbiA9IDB4ZmZkYiBt YXhfYXJjaF9wZm4gPSAweDQwMDAwMDAwMA0KWyAgICAwLjAxMDIwNF0geDg2L1BBVDogQ29uZmln dXJhdGlvbiBbMC03XTogV0IgIFdDICBVQy0gVUMgIFdCICBXUCAgVUMtIFdUICANClsgICAgMC4w MjQ2MTddIGZvdW5kIFNNUCBNUC10YWJsZSBhdCBbbWVtIDB4MDAwZjVhOTAtMHgwMDBmNWE5Zl0N ClsgICAgMC4wMjYyNzVdIGNoZWNrOiBTY2FubmluZyAxIGFyZWFzIGZvciBsb3cgbWVtb3J5IGNv cnJ1cHRpb24NClsgICAgMC4wMzA1NTldIEFDUEk6IEVhcmx5IHRhYmxlIGNoZWNrc3VtIHZlcmlm aWNhdGlvbiBkaXNhYmxlZA0KWyAgICAwLjAzMTAwMF0gQUNQSTogUlNEUCAweDAwMDAwMDAwMDAw RjU4QjAgMDAwMDE0ICh2MDAgQk9DSFMgKQ0KWyAgICAwLjAzMTI3OF0gQUNQSTogUlNEVCAweDAw MDAwMDAwMEZGRTE1NkYgMDAwMDMwICh2MDEgQk9DSFMgIEJYUENSU0RUIDAwMDAwMDAxIEJYUEMg MDAwMDAwMDEpDQpbICAgIDAuMDMxOTM5XSBBQ1BJOiBGQUNQIDB4MDAwMDAwMDAwRkZFMTQ0QiAw MDAwNzQgKHYwMSBCT0NIUyAgQlhQQ0ZBQ1AgMDAwMDAwMDEgQlhQQyAwMDAwMDAwMSkNClsgICAg MC4xNDQ2MzFdIEFDUEk6IERTRFQgMHgwMDAwMDAwMDBGRkUwMDQwIDAwMTQwQiAodjAxIEJPQ0hT ICBCWFBDRFNEVCAwMDAwMDAwMSBCWFBDIDAwMDAwMDAxKQ0KWyAgICAwLjE0NDc4NF0gQUNQSTog RkFDUyAweDAwMDAwMDAwMEZGRTAwMDAgMDAwMDQwDQpbICAgIDAuMTQ0ODkxXSBBQ1BJOiBBUElD IDB4MDAwMDAwMDAwRkZFMTRCRiAwMDAwNzggKHYwMSBCT0NIUyAgQlhQQ0FQSUMgMDAwMDAwMDEg QlhQQyAwMDAwMDAwMSkNClsgICAgMC4xNDQ5MzFdIEFDUEk6IEhQRVQgMHgwMDAwMDAwMDBGRkUx NTM3IDAwMDAzOCAodjAxIEJPQ0hTICBCWFBDSFBFVCAwMDAwMDAwMSBCWFBDIDAwMDAwMDAxKQ0K WyAgICAwLjI4MDY2Ml0gWm9uZSByYW5nZXM6DQpbICAgIDAuMjgwNzYxXSAgIERNQSAgICAgIFtt ZW0gMHgwMDAwMDAwMDAwMDAxMDAwLTB4MDAwMDAwMDAwMGZmZmZmZl0NClsgICAgMC4yODA4MTRd ICAgRE1BMzIgICAgW21lbSAweDAwMDAwMDAwMDEwMDAwMDAtMHgwMDAwMDAwMDBmZmRhZmZmXQ0K WyAgICAwLjI4MDgyN10gICBOb3JtYWwgICBlbXB0eQ0KWyAgICAwLjI4Mzg5N10gTW92YWJsZSB6 b25lIHN0YXJ0IGZvciBlYWNoIG5vZGUNClsgICAgMC4yODM5NDFdIEVhcmx5IG1lbW9yeSBub2Rl IHJhbmdlcw0KWyAgICAwLjI4Mzk3OV0gICBub2RlICAgMDogW21lbSAweDAwMDAwMDAwMDAwMDEw MDAtMHgwMDAwMDAwMDAwMDllZmZmXQ0KWyAgICAwLjI4NDEwNl0gICBub2RlICAgMDogW21lbSAw eDAwMDAwMDAwMDAxMDAwMDAtMHgwMDAwMDAwMDBmZmRhZmZmXQ0KWyAgICAwLjQ4ODA2OF0gWmVy b2VkIHN0cnVjdCBwYWdlIGluIHVuYXZhaWxhYmxlIHJhbmdlczogMTM1IHBhZ2VzDQpbICAgIDAu NDg4MjkwXSBJbml0bWVtIHNldHVwIG5vZGUgMCBbbWVtIDB4MDAwMDAwMDAwMDAwMTAwMC0weDAw MDAwMDAwMGZmZGFmZmZdDQpbICAgIDAuNTE4ODYwXSBBQ1BJOiBQTS1UaW1lciBJTyBQb3J0OiAw eDYwOA0KWyAgICAwLjUxOTQwOV0gQUNQSTogTEFQSUNfTk1JIChhY3BpX2lkWzB4ZmZdIGRmbCBk ZmwgbGludFsweDFdKQ0KWyAgICAwLjUxOTg3MV0gSU9BUElDWzBdOiBhcGljX2lkIDAsIHZlcnNp b24gMzIsIGFkZHJlc3MgMHhmZWMwMDAwMCwgR1NJIDAtMjMNClsgICAgMC41MjAwMTZdIEFDUEk6 IElOVF9TUkNfT1ZSIChidXMgMCBidXNfaXJxIDAgZ2xvYmFsX2lycSAyIGRmbCBkZmwpDQpbICAg IDAuNTIwMzI0XSBBQ1BJOiBJTlRfU1JDX09WUiAoYnVzIDAgYnVzX2lycSA1IGdsb2JhbF9pcnEg NSBoaWdoIGxldmVsKQ0KWyAgICAwLjUyMDM2NF0gQUNQSTogSU5UX1NSQ19PVlIgKGJ1cyAwIGJ1 c19pcnEgOSBnbG9iYWxfaXJxIDkgaGlnaCBsZXZlbCkNClsgICAgMC41MjA0NzNdIEFDUEk6IElO VF9TUkNfT1ZSIChidXMgMCBidXNfaXJxIDEwIGdsb2JhbF9pcnEgMTAgaGlnaCBsZXZlbCkNClsg ICAgMC41MjA0ODldIEFDUEk6IElOVF9TUkNfT1ZSIChidXMgMCBidXNfaXJxIDExIGdsb2JhbF9p cnEgMTEgaGlnaCBsZXZlbCkNClsgICAgMC41MjA3MzVdIFVzaW5nIEFDUEkgKE1BRFQpIGZvciBT TVAgY29uZmlndXJhdGlvbiBpbmZvcm1hdGlvbg0KWyAgICAwLjUyMDc5Nl0gQUNQSTogSFBFVCBp ZDogMHg4MDg2YTIwMSBiYXNlOiAweGZlZDAwMDAwDQpbICAgIDAuNTIxMTc5XSBzbXBib290OiBB bGxvd2luZyAxIENQVXMsIDAgaG90cGx1ZyBDUFVzDQpbICAgIDAuNTIyMDA0XSBbbWVtIDB4MTAw MDAwMDAtMHhmZmZiZmZmZl0gYXZhaWxhYmxlIGZvciBQQ0kgZGV2aWNlcw0KWyAgICAwLjUyMjA1 N10gQm9vdGluZyBwYXJhdmlydHVhbGl6ZWQga2VybmVsIG9uIGJhcmUgaGFyZHdhcmUNClsgICAg MC41MjI0NjhdIGNsb2Nrc291cmNlOiByZWZpbmVkLWppZmZpZXM6IG1hc2s6IDB4ZmZmZmZmZmYg bWF4X2N5Y2xlczogMHhmZmZmZmZmZiwgbWF4X2lkbGVfbnM6IDE5MTA5Njk5NDAzOTE0MTkgbnMN ClsgICAgMC41MjI5MDRdIHNldHVwX3BlcmNwdTogTlJfQ1BVUzo2NCBucl9jcHVtYXNrX2JpdHM6 NjQgbnJfY3B1X2lkczoxIG5yX25vZGVfaWRzOjENClsgICAgMC44NTIzNjhdIHBlcmNwdTogRW1i ZWRkZWQgNTEgcGFnZXMvY3B1IHMxNzA4NDAgcjgxOTIgZDI5ODY0IHUyMDk3MTUyDQpbICAgIDAu ODY1Mzk0XSBCdWlsdCAxIHpvbmVsaXN0cywgbW9iaWxpdHkgZ3JvdXBpbmcgb24uICBUb3RhbCBw YWdlczogNjQzNTYNClsgICAgMC44NjU4MDFdIEtlcm5lbCBjb21tYW5kIGxpbmU6IHJvb3Q9L2Rl di92ZGEgcncgIGNvbnNvbGU9dHR5UzAgbWVtPTI1Nk0gaXA9MTkyLjE2OC43LjE2OjoxOTIuMTY4 LjcuMTU6MjU1LjI1NS4yNTUuMCBvcHJvZmlsZS50aW1lcj0xIGNvbnNvbGU9dHR5MSBjb25zb2xl PXR0eVMwLDExNTIwMG44IHByaW50ay50aW1lPTENClsgICAgMC45NjMzMjJdIERlbnRyeSBjYWNo ZSBoYXNoIHRhYmxlIGVudHJpZXM6IDMyNzY4IChvcmRlcjogNiwgMjYyMTQ0IGJ5dGVzLCBsaW5l YXIpDQpbICAgIDAuOTY0NDIwXSBJbm9kZS1jYWNoZSBoYXNoIHRhYmxlIGVudHJpZXM6IDE2Mzg0 IChvcmRlcjogNSwgMTMxMDcyIGJ5dGVzLCBsaW5lYXIpDQpbICAgIDAuOTY3NjczXSBtZW0gYXV0 by1pbml0OiBzdGFjazpvZmYsIGhlYXAgYWxsb2M6b2ZmLCBoZWFwIGZyZWU6b2ZmDQpbICAgIDAu OTc0NzE1XSBNZW1vcnk6IDIzMjE2MEsvMjYxNjA0SyBhdmFpbGFibGUgKDE0MzQwSyBrZXJuZWwg Y29kZSwgMTQwM0sgcndkYXRhLCAzMTU2SyByb2RhdGEsIDE1NzZLIGluaXQsIDk3MksgYnNzLCAy OTQ0NEsgcmVzZXJ2ZWQsIDBLIGNtYS1yZXNlcnZlZCkNClsgICAgMS4xMzI3MTBdIFNMVUI6IEhX YWxpZ249NjQsIE9yZGVyPTAtMywgTWluT2JqZWN0cz0wLCBDUFVzPTEsIE5vZGVzPTENClsgICAg MS4xMzUxMDRdIEtlcm5lbC9Vc2VyIHBhZ2UgdGFibGVzIGlzb2xhdGlvbjogZW5hYmxlZA0KWyAg ICAxLjEzODc2NF0gZnRyYWNlOiBhbGxvY2F0aW5nIDQwMzc2IGVudHJpZXMgaW4gMTU4IHBhZ2Vz DQpbICAgIDEuNjAzNzYxXSByY3U6IFByZWVtcHRpYmxlIGhpZXJhcmNoaWNhbCBSQ1UgaW1wbGVt ZW50YXRpb24uDQpbICAgIDEuNjA0MDMwXSByY3U6IAlSQ1UgcmVzdHJpY3RpbmcgQ1BVcyBmcm9t IE5SX0NQVVM9NjQgdG8gbnJfY3B1X2lkcz0xLg0KWyAgICAxLjYwNDIyM10gCVRhc2tzIFJDVSBl bmFibGVkLg0KWyAgICAxLjYwNDMzOV0gcmN1OiBSQ1UgY2FsY3VsYXRlZCB2YWx1ZSBvZiBzY2hl ZHVsZXItZW5saXN0bWVudCBkZWxheSBpcyAxMDAgamlmZmllcy4NClsgICAgMS42MDQ0MDddIHJj dTogQWRqdXN0aW5nIGdlb21ldHJ5IGZvciByY3VfZmFub3V0X2xlYWY9MTYsIG5yX2NwdV9pZHM9 MQ0KWyAgICAxLjcwNjc0Ml0gTlJfSVJRUzogNDM1MiwgbnJfaXJxczogMjU2LCBwcmVhbGxvY2F0 ZWQgaXJxczogMTYNClsgICAgMS43NDQ5NjNdIHJhbmRvbTogZ2V0X3JhbmRvbV9ieXRlcyBjYWxs ZWQgZnJvbSBzdGFydF9rZXJuZWwrMHgzMTkvMHg0Y2Ygd2l0aCBjcm5nX2luaXQ9MA0KWyAgICAx Ljc1MzI4NF0gQ29uc29sZTogY29sb3VyIFZHQSsgODB4MjUNClsgICAgMS43NzQ3ODldIHByaW50 azogY29uc29sZSBbdHR5MV0gZW5hYmxlZA0KWyAgICAxLjc5MjI3NV0gcHJpbnRrOiBjb25zb2xl IFt0dHlTMF0gZW5hYmxlZA0KWyAgICAxLjc5MzE3NV0gQUNQSTogQ29yZSByZXZpc2lvbiAyMDE5 MDgxNg0KWyAgICAxLjgxNTUwM10gY2xvY2tzb3VyY2U6IGhwZXQ6IG1hc2s6IDB4ZmZmZmZmZmYg bWF4X2N5Y2xlczogMHhmZmZmZmZmZiwgbWF4X2lkbGVfbnM6IDE5MTEyNjA0NDY3IG5zDQpbICAg IDIuMjExMjc3XSBBUElDOiBTd2l0Y2ggdG8gc3ltbWV0cmljIEkvTyBtb2RlIHNldHVwDQpbICAg IDIuMjIxNTEyXSAuLlRJTUVSOiB2ZWN0b3I9MHgzMCBhcGljMT0wIHBpbjE9MiBhcGljMj0tMSBw aW4yPS0xDQpbICAgIDIuMjM4MjczXSAuLk1QLUJJT1MgYnVnOiA4MjU0IHRpbWVyIG5vdCBjb25u ZWN0ZWQgdG8gSU8tQVBJQw0KWyAgICAyLjIzODk5OV0gLi4udHJ5aW5nIHRvIHNldCB1cCB0aW1l ciAoSVJRMCkgdGhyb3VnaCB0aGUgODI1OUEgLi4uDQpbICAgIDIuMjM5MjgwXSAuLi4uLiAoZm91 bmQgYXBpYyAwIHBpbiAyKSAuLi4NClsgICAgMi4yNTUxODZdIC4uLi4uLi4gZmFpbGVkLg0KWyAg ICAyLjI1NTc3N10gLi4udHJ5aW5nIHRvIHNldCB1cCB0aW1lciBhcyBWaXJ0dWFsIFdpcmUgSVJR Li4uDQpbICAgIDIuMjcyMDc3XSAuLi4uLiBmYWlsZWQuDQpbICAgIDIuMjcyNDEwXSAuLi50cnlp bmcgdG8gc2V0IHVwIHRpbWVyIGFzIEV4dElOVCBJUlEuLi4NClsgICAgNC4yNTI5NTZdIC4uLi4u IGZhaWxlZCA6KC4NClsgICAgNC4yNTM3MjhdIEtlcm5lbCBwYW5pYyAtIG5vdCBzeW5jaW5nOiBJ Ty1BUElDICsgdGltZXIgZG9lc24ndCB3b3JrISAgQm9vdCB3aXRoIGFwaWM9ZGVidWcgYW5kIHNl bmQgYSByZXBvcnQuICBUaGVuIHRyeSBib290aW5nIHdpdGggdGhlICdub2FwaWMnIG9wdGlvbi4N ClsgICAgNC4yNTQ2NjZdIENQVTogMCBQSUQ6IDAgQ29tbTogc3dhcHBlci8wIE5vdCB0YWludGVk IDUuNC41MS15b2N0by1zdGFuZGFyZCAjMQ0KWyAgICA0LjI1NTM1MV0gSGFyZHdhcmUgbmFtZTog UUVNVSBTdGFuZGFyZCBQQyAoaTQ0MEZYICsgUElJWCwgMTk5NiksIEJJT1MgcmVsLTEuMTMuMC0w LWdmMjFiNWE0YWViMDItcHJlYnVpbHQucWVtdS5vcmcgMDQvMDEvMjAxNA0KWyAgICA0LjI1NjAw NF0gQ2FsbCBUcmFjZToNClsgICAgNC4yNTc3MDddICBkdW1wX3N0YWNrKzB4NTcvMHg3YQ0KWyAg ICA0LjI1ODAxMl0gIHBhbmljKzB4MTAyLzB4MmIxDQpbICAgIDQuMjU4MjI2XSAgc2V0dXBfSU9f QVBJQysweDgwMi8weDg0MQ0KWyAgICA0LjI1ODQzMF0gID8gY2xlYXJfSU9fQVBJQysweDM5LzB4 NjANClsgICAgNC4yNTg2NjNdICBhcGljX2ludHJfbW9kZV9pbml0KzB4ZjUvMHhmNw0KWyAgICA0 LjI1ODg3Nl0gIHg4Nl9sYXRlX3RpbWVfaW5pdCsweDI0LzB4MmINClsgICAgNC4yNTkwODBdICBz dGFydF9rZXJuZWwrMHg0MWYvMHg0Y2YNClsgICAgNC4yNTkyODJdICB4ODZfNjRfc3RhcnRfcmVz ZXJ2YXRpb25zKzB4MjQvMHgyNg0KWyAgICA0LjI1OTUwNV0gIHg4Nl82NF9zdGFydF9rZXJuZWwr MHg3MC8weDc0DQpbICAgIDQuMjU5NzM2XSAgc2Vjb25kYXJ5X3N0YXJ0dXBfNjQrMHhhNC8weGIw DQpbICAgIDQuMjYxMzA4XSAtLS1bIGVuZCBLZXJuZWwgcGFuaWMgLSBub3Qgc3luY2luZzogSU8t QVBJQyArIHRpbWVyIGRvZXNuJ3Qgd29yayEgIEJvb3Qgd2l0aCBhcGljPWRlYnVnIGFuZCBzZW5k IGEgcmVwb3J0LiAgVGhlbiB0cnkgYm9vdGluZyB3aXRoIHRoZSAnbm9hcGljJyBvcHRpb24uIF0t LS0NCg==