The eventreplay mechanism lets us send a stream of events to toaster. It goes through the same functional chain as "real" events from bitbake aka toaster.bbclass->buildinfohelper->ToasterDb. Because of this it makes a nice way of testing the build/bitbake interaction side of toaster. We need: 1) event files for testing (at leat 2 scenarios so we are sure the methid can be extended in the future) 2)artifact files related to those event files 3) scripts to run the tests. These tests should be able to be run from the command line. Likely the tests will reside in a separate repo as they are quite large. Perhaps the script should have the option to pull them? We should also think about how they will interact with the selenium test set since that would seem to be a good way to check the state after running the events.
Tests are written and tested. You can see them in my contrib branch: https://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=ed/toaster/tests/eventreplay (last 3 commits) I'll submit them for review after Michael's fix for signal_runbuilds is merged as my tests depend on it.
Implementation of 2 eventreplay tests has been sent to toaster mailing list for review: https://lists.yoctoproject.org/pipermail/toaster/2016-October/005277.html
The patchset has been accepted to bitbake&poky master branches.