Hi,
In my team we are using Simpletests extensively both on local workstations and on our continuous integration server.
Our workflow resembles something like this:
* before committing code to the git repo, developers run all tests pertaining the test group "my-website" and make sure they pass. This is often done in the GUI, as the GUI provides nicely themed green and red test report with links to verbose messages.
* when a change in git is detected by the continuous integration, tests are run on the command line either with drush test-run my-website
or php scripts/run-tests.sh
.
I modified Drush slightly as documented here so that, when the tests are run on the command line, the themed test reports and verbose messages (captured html code) can be stored in a given directory as a build artifact. This is very useful to quickly figure out what is going wrong with a particular build.
Moshe Weitzman suggested in this issue that it might be worth considering the possibility of adding this functionality to php scripts/run-tests.sh
.
Would there be interest in including this functionality to Drupal, as an option for php scripts/run-tests.sh
and as a checkbox on the test GUI page? When the option is selected, the themed test results and corresponding verbose messages would be saved to a given directory, for example, public://simpletest/artifacts/ or public://simpletest/artifacts/1234 (the ID of the test).
Other options would be adding this functionality to drush_extras or to a dedicated module.