Currently all the tests founds in the directory specified will run by default when the modules are not specified, and this is not the intended behaviour with this kind of tests.
Sent patch to the mailing list: https://patchwork.openembedded.org/series/6002/ Patchwork: https://patchwork.openembedded.org/series/6002/
Mailing list link: http://lists.openembedded.org/pipermail/openembedded-core/2017-March/134707.html
This has been solved in commit: http://cgit.openembedded.org/openembedded-core/commit/?id=2c6eac774768aa610a8b3784483b9e90fb629c2d