There is need to filter tests based on different things, for example, test id, test tag, test module.
This has been implemented in mariano/oeqa_improvements: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=mariano/oeqa_improvements
Sent patch for review: https://patchwork.openembedded.org/series/4272/#
This has been solved in: http://cgit.openembedded.org/openembedded-core/commit/?id=275ef03b77ef5f23b75cb01c55206d1ab0261342