6370 2014-05-23 12:01:53 +0000 QA/oe-selftest: add test suite for recipe testing 2026-03-26 14:27:09 +0000 1 1 10 QA/Testing Build Testing general 1.7 x86 Multiple NEW Medium enhancement 6.99 8332 9085 9931 1 corneliux.stoicescu richard.purdie alexandru.c.georgescu benjamin.esquivel bill.randle bluelightning markus.boos randy.macleod richard.purdie sgw --- --- Don't know oldest_to_newest 43554 0 corneliux.stoicescu 2014-05-23 12:01:53 +0000 Implement a test suite that will contain generic recipe tests. The test suite can be run after modifications have been made to a recipe to check for issues. Here is the initial proposal from the mailing list and community comments: - build the recipe with all major architectures(qemux86, qemux86-64, qemuarm, qemuppc, qemumips) - rebuild the recipe from sstate(with or without a sstate file for the recipe) - perform cleaning operations on the recipe(cleansstate, clean, cleanall) - force all major tasks on the recipe (bitbake -C <task> <recipe>) - selectively use each combination of .bbappend files with the recipe; all the combinations should not break the recipe build. - we could also create mini test suites just for some of these tests like testing only the rebuild from sstate. Community input: - boot in qemu and do ptest suite 55886 1 bluelightning 2015-10-28 10:13:40 +0000 This perhaps ties in with bug 4078. 55927 2 bluelightning 2015-10-28 14:26:48 +0000 I suspect this isn't going to fit into oe-selftest, since it's going to need to take the recipe to test as input. It's also worth noting that the automatic upgrade helper already does some of this. 56252 3 benjamin.esquivel 2015-11-05 23:15:30 +0000 This bug is a dependency of 8648 which is targeted by 2.1 M1, it means we need to change this to the same milestone to make it happen. 56930 4 daniel.alexandrux.istrate 2015-12-02 10:16:20 +0000 Hi Benjamin, I haven't had the time to take care of this one, as my main focus is now on #8647. If this is blocking you, and you have the resources, please feel free to change it's status accordingly. Thanks, --Daniel 56951 5 benjamin.esquivel 2015-12-02 16:34:15 +0000 Thanks for the comment Daniel, will check that option. 57941 6 daniel.alexandrux.istrate 2016-01-19 09:51:51 +0000 This is going to be a separate tool 'test-recipe' that will run the 'recipe tests'. All these tests will require as argument the recipe to test on. The script: scripts/test-recipe The tests: meta/lib/oeqa/recipe-tests/ Proposed usage: test-recipe --recipe recipe_x --run-tests test_1 test_2 test-recipe --recipe recipe_x --run-tests all test-recipe --list-tests test-recipe will create an environment variable TESTRECIPE that each test will know about it. This way we can pass arguments to tests. 58792 7 benjamin.esquivel 2016-02-09 15:54:28 +0000 Per our conversation between Paul and I, it would be useful to know whether this enhancement is a matter of adding more QA checks (http://www.yoctoproject.org/docs/current/ref-manual/ref-manual.html#ref-qa-checks) or extending them. I believe the current design is set for being a command line callable set of tests and if that's the case, I wonder where in the automation will they fit, is the current design to tie them to oe-selftest? 59498 8 daniel.alexandrux.istrate 2016-02-26 14:51:05 +0000 Patch sent to ML: http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118170.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118171.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118172.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118173.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118174.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118175.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118176.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118177.html http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118178.html Also available at: https://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=distrate/bug_6370_testrecipe_final This tool shares many functionality with oe-selftest. It requires an additional parameter '--recipes <recipe>' to know on which recipe to run tests against. Tests are located in meta/lib/oeqa/recipetests/ --Daniel 59499 9 3006 daniel.alexandrux.istrate 2016-02-26 14:57:04 +0000 Created attachment 3006 test-recipe demo 67950 10 benjamin.esquivel 2016-11-03 22:17:02 +0000 I'm taking this bug since I need to see what is going to happen with it. 67971 11 benjamin.esquivel 2016-11-04 14:39:04 +0000 Chatting with Paul we decided this enhancement request will not get attention in 2.3 so setting its target milestone to future. 82364 12 richard.purdie 2018-11-29 16:31:43 +0000 http://lists.openembedded.org/pipermail/openembedded-core/2016-February/118175.html has good ideas 3006 2016-02-26 14:57:04 +0000 2016-02-26 14:57:04 +0000 test-recipe demo test_recipe_demo.txt text/plain 10657 daniel.alexandrux.istrate MTY6MTA6MjEgW2RhbmllbEBmZWRvcmEtd3MgcG9reS1idWlsZDNdJCB0ZXN0LXJlY2lwZSAtciBl ZCAtLXJ1bi1hbGwtdGVzdHMNCjIwMTYtMDItMjYgMTY6MTE6MzcgLSB0ZXN0LXJlY2lwZSAtIElO Rk8gLSBDaGVja2luZyB0aGF0IGV2ZXJ5dGhpbmcgaXMgaW4gb3JkZXIgYmVmb3JlIHJ1bm5pbmcg dGhlIHRlc3RzDQoyMDE2LTAyLTI2IDE2OjExOjQwIC0gdGVzdC1yZWNpcGUgLSBJTkZPIC0gUnVu bmluZyBiaXRiYWtlIC1wDQoyMDE2LTAyLTI2IDE2OjExOjQ0IC0gdGVzdC1yZWNpcGUgLSBJTkZP IC0gUnVubmluZyB0ZXN0cyBmb3IgcmVjaXBlICJlZCIgLi4uDQoyMDE2LTAyLTI2IDE2OjExOjQ3 IC0gdGVzdC1yZWNpcGUgLSBJTkZPIC0gQWRkaW5nOiBbJ3JlcXVpcmVkLmluYycsICd0ZXN0cmVj aXBlLmluYyddIGluIGxvY2FsLmNvbmYNCjIwMTYtMDItMjYgMTY6MTE6NDcgLSB0ZXN0LXJlY2lw ZSAtIElORk8gLSBBZGRpbmc6IGJibGF5ZXJzLmluYyBpbiBiYmxheWVycy5jb25mDQoyMDE2LTAy LTI2IDE2OjExOjQ3IC0gdGVzdC1yZWNpcGUgLSBJTkZPIC0gTG9hZGluZyB0ZXN0cyBmcm9tOiBv ZXFhLnJlY2lwZXRlc3RzLmJ1aWxkcmVjaXBlDQoyMDE2LTAyLTI2IDE2OjExOjQ3IC0gdGVzdF9i dWlsZF9yZWNpcGVfZm9yX2FsbF9tYWpvcl9hcmNoaXRlY3R1cmVzIChvZXFhLnJlY2lwZXRlc3Rz LmJ1aWxkcmVjaXBlLkJ1aWxkUmVjaXBlVGVzdHMpDQpCdWlsZCB0aGUgcmVjaXBlIHdpdGggYWxs IG1ham9yIGFyY2hpdGVjdHVyZXMocWVtdXg4NiwgcWVtdXg4Ni02NCwgcWVtdWFybSwgcWVtdXBw YywgcWVtdW1pcHMpIC4uLiAyMDE2LTAyLTI2IDE2OjExOjUwIC0gdGVzdC1yZWNpcGUuYnVpbGQt cmVjaXBlIC0gSU5GTyAtIEJ1aWxkaW5nIHJlY2lwZSAiZWQiIGZvciBhcmNoaXRlY3R1cmUgInFl bXV4ODZjb3B5Ig0KMjAxNi0wMi0yNiAxNjoxMjoyOCAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lw ZSAtIElORk8gLSBCdWlsZGluZyByZWNpcGUgImVkIiBmb3IgYXJjaGl0ZWN0dXJlICJxZW11eDg2 LTY0Ig0KMjAxNi0wMi0yNiAxNjoxMzowOCAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElO Rk8gLSBCdWlsZGluZyByZWNpcGUgImVkIiBmb3IgYXJjaGl0ZWN0dXJlICJxZW11bWlwcyINCjIw MTYtMDItMjYgMTY6MTM6NDYgLSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQnVp bGRpbmcgcmVjaXBlICJlZCIgZm9yIGFyY2hpdGVjdHVyZSAicWVtdWFybSINCjIwMTYtMDItMjYg MTY6MTQ6MjYgLSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQnVpbGRpbmcgcmVj aXBlICJlZCIgZm9yIGFyY2hpdGVjdHVyZSAicWVtdXg4NiINCjIwMTYtMDItMjYgMTY6MTU6MDEg LSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQnVpbGRpbmcgcmVjaXBlICJlZCIg Zm9yIGFyY2hpdGVjdHVyZSAicWVtdXBwYyINCjIwMTYtMDItMjYgMTY6MTU6NDEgLSB0ZXN0LXJl Y2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQnVpbGRpbmcgcmVjaXBlICJlZCIgZm9yIGFyY2hp dGVjdHVyZSAicWVtdW1pcHM2NCINCjIwMTYtMDItMjYgMTY6MTY6MjIgLSB0ZXN0LXJlY2lwZS5i dWlsZC1yZWNpcGUgLSBJTkZPIC0gQnVpbGRpbmcgcmVjaXBlICJlZCIgZm9yIGFyY2hpdGVjdHVy ZSAicWVtdWFybTY0Ig0Kb2sNCjIwMTYtMDItMjYgMTY6MTc6MDQgLSB0ZXN0LXJlY2lwZSAtIFJF U1VMVFMgLSBUZXN0Y2FzZSB0ZXN0X2J1aWxkX3JlY2lwZV9mb3JfYWxsX21ham9yX2FyY2hpdGVj dHVyZXM6IFBBU1NFRA0KMjAxNi0wMi0yNiAxNjoxNzowNCAtIHRlc3RfY2xlYW5pbmdfb3BlcmF0 aW9uc19vbl9yZWNpcGUgKG9lcWEucmVjaXBldGVzdHMuYnVpbGRyZWNpcGUuQnVpbGRSZWNpcGVU ZXN0cykNClBlcmZvcm0gY2xlYW5pbmcgb3BlcmF0aW9ucyBvbiB0aGUgcmVjaXBlKGNsZWFuc3N0 YXRlLCBjbGVhbiwgY2xlYW5hbGwpIC4uLiAyMDE2LTAyLTI2IDE2OjE3OjEyIC0gdGVzdC1yZWNp cGUuYnVpbGQtcmVjaXBlIC0gSU5GTyAtIFBlcmZvcm1pbmcgY2xlYW5zc3RhdGUgZm9yIHJlY2lw ZSBlZA0KMjAxNi0wMi0yNiAxNjoxODoxNCAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElO Rk8gLSBQZXJmb3JtaW5nIGNsZWFuIGZvciByZWNpcGUgZWQNCjIwMTYtMDItMjYgMTY6MTg6MzAg LSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gUGVyZm9ybWluZyBjbGVhbmFsbCBm b3IgcmVjaXBlIGVkDQpvaw0KMjAxNi0wMi0yNiAxNjoxODo0OCAtIHRlc3QtcmVjaXBlIC0gUkVT VUxUUyAtIFRlc3RjYXNlIHRlc3RfY2xlYW5pbmdfb3BlcmF0aW9uc19vbl9yZWNpcGU6IFBBU1NF RA0KMjAxNi0wMi0yNiAxNjoxODo0OCAtIHRlc3RfY29tYmluYXRpb25zX29mX2JiYXBwZW5kIChv ZXFhLnJlY2lwZXRlc3RzLmJ1aWxkcmVjaXBlLkJ1aWxkUmVjaXBlVGVzdHMpDQpTZWxlY3RpdmVs eSB1c2UgZWFjaCBjb21iaW5hdGlvbiBvZiAuYmJhcHBlbmQgZmlsZXMgd2l0aCB0aGUgcmVjaXBl IC4uLiAyMDE2LTAyLTI2IDE2OjE5OjAxIC0gdGVzdC1yZWNpcGUuYnVpbGQtcmVjaXBlIC0gSU5G TyAtIEFsbCBiYmFwcGVuZHMgZm9yIHJlY2lwZSBlZDogWycvaG9tZS9kYW5pZWwvcG9reS9tZXRh LXNlbGZ0ZXN0L3JlY2lwZXMtdGVzdC9lZF90ZXN0XzQvZWRfMS45LmJiYXBwZW5kJywgJy9ob21l L2RhbmllbC9wb2t5L21ldGEtc2VsZnRlc3QvcmVjaXBlcy10ZXN0L2VkX3Rlc3RfMy9lZF8xLjku YmJhcHBlbmQnLCAnL2hvbWUvZGFuaWVsL3Bva3kvbWV0YS1zZWxmdGVzdC9yZWNpcGVzLXRlc3Qv ZWRfdGVzdF8xL2VkXzEuOS5iYmFwcGVuZCcsICcvaG9tZS9kYW5pZWwvcG9reS9tZXRhLXNlbGZ0 ZXN0L3JlY2lwZXMtdGVzdC9lZF90ZXN0XzIvZWRfMS45LmJiYXBwZW5kJ10NCjIwMTYtMDItMjYg MTY6MTk6MTYgLSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQXBwbGllZCBNQVNL cyBbL2hvbWUvZGFuaWVsL3Bva3kvbWV0YS1zZWxmdGVzdC9yZWNpcGVzLXRlc3QvZWRfdGVzdF8x L2VkXzEuOS5iYmFwcGVuZCwgL2hvbWUvZGFuaWVsL3Bva3kvbWV0YS1zZWxmdGVzdC9yZWNpcGVz LXRlc3QvZWRfdGVzdF80L2VkXzEuOS5iYmFwcGVuZF0NCjIwMTYtMDItMjYgMTY6MTk6NDMgLSB0 ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQ3VycmVudCBiYmFwcGVuZHMgZm9yIHJl Y2lwZSBlZDogWycvaG9tZS9kYW5pZWwvcG9reS9tZXRhLXNlbGZ0ZXN0L3JlY2lwZXMtdGVzdC9l ZF90ZXN0XzMvZWRfMS45LmJiYXBwZW5kJywgJy9ob21lL2RhbmllbC9wb2t5L21ldGEtc2VsZnRl c3QvcmVjaXBlcy10ZXN0L2VkX3Rlc3RfMi9lZF8xLjkuYmJhcHBlbmQnXQ0KMjAxNi0wMi0yNiAx NjoxOTo0OCAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBDdXJyZW50IHN1bW1h cnk6ICJMaW5lLW9yaWVudGVkIHRleHQgZWRpdG9yIG1zZyAzIG1zZyAyIg0KMjAxNi0wMi0yNiAx NjoyMDowMCAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBBcHBsaWVkIE1BU0tz IFsvaG9tZS9kYW5pZWwvcG9reS9tZXRhLXNlbGZ0ZXN0L3JlY2lwZXMtdGVzdC9lZF90ZXN0XzQv ZWRfMS45LmJiYXBwZW5kLCAvaG9tZS9kYW5pZWwvcG9reS9tZXRhLXNlbGZ0ZXN0L3JlY2lwZXMt dGVzdC9lZF90ZXN0XzIvZWRfMS45LmJiYXBwZW5kXQ0KMjAxNi0wMi0yNiAxNjoyMDoyNyAtIHRl c3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBDdXJyZW50IGJiYXBwZW5kcyBmb3IgcmVj aXBlIGVkOiBbJy9ob21lL2RhbmllbC9wb2t5L21ldGEtc2VsZnRlc3QvcmVjaXBlcy10ZXN0L2Vk X3Rlc3RfMy9lZF8xLjkuYmJhcHBlbmQnLCAnL2hvbWUvZGFuaWVsL3Bva3kvbWV0YS1zZWxmdGVz dC9yZWNpcGVzLXRlc3QvZWRfdGVzdF8xL2VkXzEuOS5iYmFwcGVuZCddDQoyMDE2LTAyLTI2IDE2 OjIwOjMyIC0gdGVzdC1yZWNpcGUuYnVpbGQtcmVjaXBlIC0gSU5GTyAtIEN1cnJlbnQgc3VtbWFy eTogIkxpbmUtb3JpZW50ZWQgdGV4dCBlZGl0b3IgbXNnIDMgbXNnIDEiDQoyMDE2LTAyLTI2IDE2 OjIwOjQ1IC0gdGVzdC1yZWNpcGUuYnVpbGQtcmVjaXBlIC0gSU5GTyAtIEFwcGxpZWQgTUFTS3Mg Wy9ob21lL2RhbmllbC9wb2t5L21ldGEtc2VsZnRlc3QvcmVjaXBlcy10ZXN0L2VkX3Rlc3RfNC9l ZF8xLjkuYmJhcHBlbmQsIC9ob21lL2RhbmllbC9wb2t5L21ldGEtc2VsZnRlc3QvcmVjaXBlcy10 ZXN0L2VkX3Rlc3RfMi9lZF8xLjkuYmJhcHBlbmRdDQoyMDE2LTAyLTI2IDE2OjIwOjUxIC0gdGVz dC1yZWNpcGUuYnVpbGQtcmVjaXBlIC0gSU5GTyAtIEN1cnJlbnQgYmJhcHBlbmRzIGZvciByZWNp cGUgZWQ6IFsnL2hvbWUvZGFuaWVsL3Bva3kvbWV0YS1zZWxmdGVzdC9yZWNpcGVzLXRlc3QvZWRf dGVzdF8zL2VkXzEuOS5iYmFwcGVuZCcsICcvaG9tZS9kYW5pZWwvcG9reS9tZXRhLXNlbGZ0ZXN0 L3JlY2lwZXMtdGVzdC9lZF90ZXN0XzEvZWRfMS45LmJiYXBwZW5kJ10NCjIwMTYtMDItMjYgMTY6 MjA6NTYgLSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQ3VycmVudCBzdW1tYXJ5 OiAiTGluZS1vcmllbnRlZCB0ZXh0IGVkaXRvciBtc2cgMyBtc2cgMSINCjIwMTYtMDItMjYgMTY6 MjE6MDQgLSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQXBwbGllZCBNQVNLcyBb L2hvbWUvZGFuaWVsL3Bva3kvbWV0YS1zZWxmdGVzdC9yZWNpcGVzLXRlc3QvZWRfdGVzdF8xL2Vk XzEuOS5iYmFwcGVuZCwgL2hvbWUvZGFuaWVsL3Bva3kvbWV0YS1zZWxmdGVzdC9yZWNpcGVzLXRl c3QvZWRfdGVzdF8zL2VkXzEuOS5iYmFwcGVuZF0NCjIwMTYtMDItMjYgMTY6MjE6MzEgLSB0ZXN0 LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gQ3VycmVudCBiYmFwcGVuZHMgZm9yIHJlY2lw ZSBlZDogWycvaG9tZS9kYW5pZWwvcG9reS9tZXRhLXNlbGZ0ZXN0L3JlY2lwZXMtdGVzdC9lZF90 ZXN0XzQvZWRfMS45LmJiYXBwZW5kJywgJy9ob21lL2RhbmllbC9wb2t5L21ldGEtc2VsZnRlc3Qv cmVjaXBlcy10ZXN0L2VkX3Rlc3RfMi9lZF8xLjkuYmJhcHBlbmQnXQ0KMjAxNi0wMi0yNiAxNjoy MTozNiAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBDdXJyZW50IHN1bW1hcnk6 ICJMaW5lLW9yaWVudGVkIHRleHQgZWRpdG9yIG1zZyA0IG1zZyAyIg0Kb2sNCjIwMTYtMDItMjYg MTY6MjE6NDcgLSB0ZXN0LXJlY2lwZSAtIFJFU1VMVFMgLSBUZXN0Y2FzZSB0ZXN0X2NvbWJpbmF0 aW9uc19vZl9iYmFwcGVuZDogUEFTU0VEDQoyMDE2LTAyLTI2IDE2OjIxOjQ3IC0gdGVzdF9mb3Jj ZV9tYWpvcl90YXNrc19vbl9yZWNpcGUgKG9lcWEucmVjaXBldGVzdHMuYnVpbGRyZWNpcGUuQnVp bGRSZWNpcGVUZXN0cykNCkZvcmNlIGFsbCBtYWpvciB0YXNrcyBvbiB0aGUgcmVjaXBlIChiaXRi YWtlIC1DIDx0YXNrPiA8cmVjaXBlPikgLi4uIDIwMTYtMDItMjYgMTY6MjI6MTIgLSB0ZXN0LXJl Y2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gRm9yY2luZyB0YXNrIHVucGFjaw0KMjAxNi0wMi0y NiAxNjoyMjozNSAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBGb3JjaW5nIHRh c2sgcGF0Y2gNCjIwMTYtMDItMjYgMTY6MjI6NDggLSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUg LSBJTkZPIC0gRm9yY2luZyB0YXNrIGNvbmZpZ3VyZQ0KMjAxNi0wMi0yNiAxNjoyMzowMiAtIHRl c3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBGb3JjaW5nIHRhc2sgY29tcGlsZQ0KMjAx Ni0wMi0yNiAxNjoyMzoxNSAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBGb3Jj aW5nIHRhc2sgaW5zdGFsbA0KMjAxNi0wMi0yNiAxNjoyMzoyNyAtIHRlc3QtcmVjaXBlLmJ1aWxk LXJlY2lwZSAtIElORk8gLSBGb3JjaW5nIHRhc2sgcG9wdWxhdGVfc3lzcm9vdA0KMjAxNi0wMi0y NiAxNjoyMzozNSAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lwZSAtIElORk8gLSBGb3JjaW5nIHRh c2sgcGFja2FnZQ0KMjAxNi0wMi0yNiAxNjoyMzo0NyAtIHRlc3QtcmVjaXBlLmJ1aWxkLXJlY2lw ZSAtIElORk8gLSBGb3JjaW5nIHRhc2sgcGFja2FnZV93cml0ZV9ycG0NCjIwMTYtMDItMjYgMTY6 MjM6NTcgLSB0ZXN0LXJlY2lwZS5idWlsZC1yZWNpcGUgLSBJTkZPIC0gRm9yY2luZyB0YXNrIHBh Y2thZ2Vfd3JpdGVfZGViDQoyMDE2LTAyLTI2IDE2OjI0OjA3IC0gdGVzdC1yZWNpcGUuYnVpbGQt cmVjaXBlIC0gSU5GTyAtIEZvcmNpbmcgdGFzayBwYWNrYWdlX3dyaXRlX2lwaw0Kb2sNCjIwMTYt MDItMjYgMTY6MjQ6MTcgLSB0ZXN0LXJlY2lwZSAtIFJFU1VMVFMgLSBUZXN0Y2FzZSB0ZXN0X2Zv cmNlX21ham9yX3Rhc2tzX29uX3JlY2lwZTogUEFTU0VEDQoyMDE2LTAyLTI2IDE2OjI0OjE3IC0g dGVzdF9yZWJ1aWxkX3JlY2lwZV9mcm9tX3NzdGF0ZV8xIChvZXFhLnJlY2lwZXRlc3RzLmJ1aWxk cmVjaXBlLkJ1aWxkUmVjaXBlVGVzdHMpDQpSZWJ1aWxkIHRoZSByZWNpcGUgZnJvbSBzc3RhdGUg d2l0aCBzc3RhdGUgZmlsZSBmb3IgdGhlIHJlY2lwZSAuLi4gb2sNCjIwMTYtMDItMjYgMTY6MjQ6 NDkgLSB0ZXN0LXJlY2lwZSAtIFJFU1VMVFMgLSBUZXN0Y2FzZSB0ZXN0X3JlYnVpbGRfcmVjaXBl X2Zyb21fc3N0YXRlXzE6IFBBU1NFRA0KMjAxNi0wMi0yNiAxNjoyNDo0OSAtIHRlc3RfcmVidWls ZF9yZWNpcGVfZnJvbV9zc3RhdGVfMiAob2VxYS5yZWNpcGV0ZXN0cy5idWlsZHJlY2lwZS5CdWls ZFJlY2lwZVRlc3RzKQ0KUmVidWlsZCB0aGUgcmVjaXBlIGZyb20gc3N0YXRlIHdpdGhvdXQgc3N0 YXRlIGZpbGUgZm9yIHRoZSByZWNpcGUgLi4uIG9rDQoyMDE2LTAyLTI2IDE2OjI1OjQzIC0gdGVz dC1yZWNpcGUgLSBSRVNVTFRTIC0gVGVzdGNhc2UgdGVzdF9yZWJ1aWxkX3JlY2lwZV9mcm9tX3Nz dGF0ZV8yOiBQQVNTRUQNCg0KLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQ0KUmFuIDYgdGVzdHMgaW4gODM1LjY0OXMN Cg0KT0sNCjIwMTYtMDItMjYgMTY6MjU6NDMgLSB0ZXN0LXJlY2lwZSAtIElORk8gLSBGaW5pc2hl ZA0KMjAxNi0wMi0yNiAxNjoyNTo0MyAtIHRlc3QtcmVjaXBlIC0gSU5GTyAtIFJlbW92aW5nIHRo ZSBpbmNsdWRlIGZyb20gbG9jYWwuY29uZg0KMjAxNi0wMi0yNiAxNjoyNTo0MyAtIHRlc3QtcmVj aXBlIC0gSU5GTyAtIFJlbW92aW5nIHRoZSBpbmNsdWRlIGZyb20gYmJsYXllcnMuY29uZg0KMTY6 MjU6NDYgW2RhbmllbEBmZWRvcmEtd3MgcG9reS1idWlsZDNdJCANCjE2OjU1OjIxIFtkYW5pZWxA ZmVkb3JhLXdzIHBva3ktYnVpbGQzXSQgdGVzdC1yZWNpcGUgLS1saXN0LXRlc3RzDQpERUJVRzog dGMgaWQgbWlzc2luZyBmb3IgdGVzdF9idWlsZF9yZWNpcGVfZm9yX2FsbF9tYWpvcl9hcmNoaXRl Y3R1cmVzDQpERUJVRzogdGMgaWQgbWlzc2luZyBmb3IgdGVzdF9jbGVhbmluZ19vcGVyYXRpb25z X29uX3JlY2lwZQ0KREVCVUc6IHRjIGlkIG1pc3NpbmcgZm9yIHRlc3RfY29tYmluYXRpb25zX29m X2JiYXBwZW5kDQpERUJVRzogdGMgaWQgbWlzc2luZyBmb3IgdGVzdF9mb3JjZV9tYWpvcl90YXNr c19vbl9yZWNpcGUNCkRFQlVHOiB0YyBpZCBtaXNzaW5nIGZvciB0ZXN0X3JlYnVpbGRfcmVjaXBl X2Zyb21fc3N0YXRlXzENCkRFQlVHOiB0YyBpZCBtaXNzaW5nIGZvciB0ZXN0X3JlYnVpbGRfcmVj aXBlX2Zyb21fc3N0YXRlXzINCmlkICAJdGFnICAgICAgICAgICAgICAgICAJbmFtZSAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCWNsYXNzICAg ICAgICAgICAgICAgICAgICAJbW9kdWxlICAgICAgICAgICAgICANCl9fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXw0KTm9uZQlOb25lICAgICAgICAgICAgICAgIAl0ZXN0X2J1aWxk X3JlY2lwZV9mb3JfYWxsX21ham9yX2FyY2hpdGVjdHVyZXMgICAgICAgICAgICAgICAJQnVpbGRS ZWNpcGVUZXN0cyAgICAgICAgIAlidWlsZHJlY2lwZSAgICAgICAgIA0KTm9uZQlOb25lICAgICAg ICAgICAgICAgIAl0ZXN0X2NsZWFuaW5nX29wZXJhdGlvbnNfb25fcmVjaXBlICAgICAgICAgICAg ICAgICAgICAgICAgICAJQnVpbGRSZWNpcGVUZXN0cyAgICAgICAgIAlidWlsZHJlY2lwZSAgICAg ICAgIA0KTm9uZQlOb25lICAgICAgICAgICAgICAgIAl0ZXN0X2NvbWJpbmF0aW9uc19vZl9iYmFw cGVuZCAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAJQnVpbGRSZWNpcGVUZXN0cyAgICAg ICAgIAlidWlsZHJlY2lwZSAgICAgICAgIA0KTm9uZQlOb25lICAgICAgICAgICAgICAgIAl0ZXN0 X2ZvcmNlX21ham9yX3Rhc2tzX29uX3JlY2lwZSAgICAgICAgICAgICAgICAgICAgICAgICAgICAJ QnVpbGRSZWNpcGVUZXN0cyAgICAgICAgIAlidWlsZHJlY2lwZSAgICAgICAgIA0KTm9uZQlOb25l ICAgICAgICAgICAgICAgIAl0ZXN0X3JlYnVpbGRfcmVjaXBlX2Zyb21fc3N0YXRlXzEgICAgICAg ICAgICAgICAgICAgICAgICAgICAJQnVpbGRSZWNpcGVUZXN0cyAgICAgICAgIAlidWlsZHJlY2lw ZSAgICAgICAgIA0KTm9uZQlOb25lICAgICAgICAgICAgICAgIAl0ZXN0X3JlYnVpbGRfcmVjaXBl X2Zyb21fc3N0YXRlXzIgICAgICAgICAgICAgICAgICAgICAgICAgICAJQnVpbGRSZWNpcGVUZXN0 cyAgICAgICAgIAlidWlsZHJlY2lwZSAgICAgICAgIA0KX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fDQpUb3RhbCBmb3VuZDoJIDYNCjE2OjU1OjMwIFtkYW5pZWxAZmVkb3JhLXdz IHBva3ktYnVpbGQzXSQgdGVzdC1yZWNpcGUgLWgNCnVzYWdlOiB0ZXN0LXJlY2lwZSBbLWhdIFst LXJ1bi10ZXN0cyBbUlVOX1RFU1RTIFtSVU5fVEVTVFMgLi4uXV1dDQogICAgICAgICAgICAgICAg ICAgWy0tcnVuLWFsbC10ZXN0c10gWy0tbGlzdC1tb2R1bGVzXSBbLS1saXN0LWNsYXNzZXNdDQog ICAgICAgICAgICAgICAgICAgWy0tY292ZXJhZ2VdDQogICAgICAgICAgICAgICAgICAgWy0tcnVu LXRlc3RzLWJ5IFtSVU5fVEVTVFNfQlkgW1JVTl9URVNUU19CWSAuLi5dXV0NCiAgICAgICAgICAg ICAgICAgICBbLS1saXN0LXRlc3RzLWJ5IFtMSVNUX1RFU1RTX0JZIFtMSVNUX1RFU1RTX0JZIC4u Ll1dXQ0KICAgICAgICAgICAgICAgICAgIFstLWxpc3QtdGVzdHNdIFstLWxpc3QtdGFnc10gWy1y IFJFQ0lQRVMgW1JFQ0lQRVMgLi4uXV0NCg0KV2lsbCBydW4gcmVjaXBlIHRlc3RzIG9uIHByb3Zp ZGVkIHJlY2lwZS4NCg0Kb3B0aW9uYWwgYXJndW1lbnRzOg0KICAtaCwgLS1oZWxwICAgICAgICAg ICAgc2hvdyB0aGlzIGhlbHAgbWVzc2FnZSBhbmQgZXhpdA0KICAtLXJ1bi10ZXN0cyBbUlVOX1RF U1RTIFtSVU5fVEVTVFMgLi4uXV0NCiAgICAgICAgICAgICAgICAgICAgICAgIFNlbGVjdCB3aGF0 IHRlc3RzIHRvIHJ1biAobW9kdWxlcywgY2xhc3NlcyBvciB0ZXN0DQogICAgICAgICAgICAgICAg ICAgICAgICBtZXRob2RzKS4gRm9ybWF0IHNob3VsZCBiZToNCiAgICAgICAgICAgICAgICAgICAg ICAgIDxtb2R1bGU+LjxjbGFzcz4uPHRlc3RfbWV0aG9kPg0KICAtLXJ1bi1hbGwtdGVzdHMgICAg ICAgUnVuIGFsbCAodW5oaWRkZW4pIHRlc3RzDQogIC0tbGlzdC1tb2R1bGVzICAgICAgICBMaXN0 IGFsbCBhdmFpbGFibGUgdGVzdCBtb2R1bGVzLg0KICAtLWxpc3QtY2xhc3NlcyAgICAgICAgTGlz dCBhbGwgYXZhaWxhYmxlIHRlc3QgY2xhc3Nlcy4NCiAgLS1jb3ZlcmFnZSAgICAgICAgICAgIFJ1 biBjb2RlIGNvdmVyYWdlIHdoZW4gdGVzdGluZw0KICAtLXJ1bi10ZXN0cy1ieSBbUlVOX1RFU1RT X0JZIFtSVU5fVEVTVFNfQlkgLi4uXV0NCiAgICAgICAgICAgICAgICAgICAgICAgIHJ1bi10ZXN0 cy1ieSA8bmFtZXxjbGFzc3xtb2R1bGV8aWR8dGFnPiA8bGlzdCBvZg0KICAgICAgICAgICAgICAg ICAgICAgICAgdGVzdHN8Y2xhc3Nlc3xtb2R1bGVzfGlkc3x0YWdzPg0KICAtLWxpc3QtdGVzdHMt YnkgW0xJU1RfVEVTVFNfQlkgW0xJU1RfVEVTVFNfQlkgLi4uXV0NCiAgICAgICAgICAgICAgICAg ICAgICAgIGxpc3QtdGVzdHMtYnkgPG5hbWV8Y2xhc3N8bW9kdWxlfGlkfHRhZz4gPGxpc3Qgb2YN CiAgICAgICAgICAgICAgICAgICAgICAgIHRlc3RzfGNsYXNzZXN8bW9kdWxlc3xpZHN8dGFncz4N CiAgLS1saXN0LXRlc3RzICAgICAgICAgIExpc3QgYWxsIGF2YWlsYWJsZSB0ZXN0cy4NCiAgLS1s aXN0LXRhZ3MgICAgICAgICAgIExpc3QgYWxsIHRhZ3MgdGhhdCBoYXZlIGJlZW4gc2V0IHRvIHRl c3QgY2FzZXMuDQogIC1yIFJFQ0lQRVMgW1JFQ0lQRVMgLi4uXSwgLS1yZWNpcGVzIFJFQ0lQRVMg W1JFQ0lQRVMgLi4uXQ0KICAgICAgICAgICAgICAgICAgICAgICAgcmVjaXBlKHMpIHRvIHJ1biB0 ZXN0cyBhZ2FpbnN0Lg0KMTY6NTY6MDIgW2RhbmllbEBmZWRvcmEtd3MgcG9reS1idWlsZDNdJA==