Problem/Motivation
This is almost a bug, but I'll call it a task.
run-tests.sh
can run PHPUnit-based tests.
However, it can't reflect that a test was skipped.
This is due to two factors:
1) simpletest (and thus run-tests.sh
) doesn't have a concept of a skipped test.
2) When a PHPUnit test is skipped, only junit reports will give a clue, which is that the test doesn't pass, fail, or error out.
What run-tests.sh
does with this is turn it into a pass, because nothing failed or errored out.
Since functional-javascript tests are skipped when phantomJS is not available, this means that tests run using run-tests.sh
could look like they're passing when in fact they did not run.
Unfortunately, there doesn't seem to be an easy way to turn skipped tests into fails, without adding a test listener.
Thus, we should modify run-tests.sh
to look for the special case of skipped so that users will know that their phantomJS-based tests did not pass because they didn't run.
Since we're doing that, we should work on risky status, as well.