The autobuilder takes a lot of time to execute a single run of oe-selftest. Sometimes there is just need to run a subset of tests and overriding what test to execute (-r option) would speed up the testing. A field in the autobuilders to override the -r option might be the solution for this.
unable to plan this for 2.3, setting it for future.
Since autobuilder2 was introduce, there are options to include the oe-selftest with -r option thru the customize template. This is one of the option if required to run specific tests. http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder-helper/tree/config.json#n191
Not clear how this would be configured using the UI. A good idea but not practical.