The test expects 'bitbake -e' to return a variable (LIC_FILES_CHKSUM) or raise an ERROR when it is not present on a new recipe. The latter doesn't happen as bitbake will build any recipe without a license file checksum specified, meaning the test is not reliable and it should be modified using tinfoil to avoid further issues.
I think this issue might be solved already as we are using Tinfoil now. Have to double check if this still applies or if it's already corrected.
This is not an issue anymore on master-next; the code was changed and this test case uses tinfoil instead of bitbake directly, meaning the variable in the description is not present anymore. I'll change the status to "IN PROGRESS REVIEW" as the branch that solves this (and many other issues) is not yet merged on master.
As mentioned before, this is not an issue anymore, but we are still testing. Moving this to 2.5 M1, it should be solved before M1 ends.
Latest changes on master solve this issue. http://git.yoctoproject.org/cgit/cgit.cgi/patchtest-oe/log/
Forgot to change the status to Resolved Fixed.