This issue is intended as a tracking issue only to list all of the known intermittent test failures affecting Drupal core. Some issues are due to bugs in Drupal core; others may be due to issues with DrupalCI infrastructure.
Only open issues should be listed in the summary.
Drupal 8
Consistent failures
Intermittent failures
- #2806697: Random fail for AlreadyInstalledException
- #2828143: Stop tests like LocaleConfigTranslationImportTest from failing if l.d.o becomes unavailable
- #2796757: Failing test with stable version string
- #2825845: DST-related test failures in FilterDateTimeTest
- #2843024: Random fail in LanguageUILanguageNegotiationTest
- #2906317: Random fail due to problems with database
- #2926309: Random fail due to APCu not being able to allocate memory
- #2924753: Random fail in ExposedFormUITest
- #2920590: (canard?) Big Bos of Random Fails is ChainedFastBackend::markAsOutdated()
- #2934997: Intermittent failure in MediaUiJavascriptTest
- #2936427: Intermittent failure in MediaSourceImageTest
- #2975644: Random Failure in Drupal\Tests\Core\Command\QuickStartTest
Investigation and hardening for past random failures
- #2853905: Figure out why there were segfaults in every test run on PHP 7.1.x-dev
- #2842393: Discover why gc_disable() improves update.php stability
- #2919863: Discover why gc_disable() during non-interactive install improves tests stability
- #2936432: Review use of pressButton() in functional javascript tests in the Media module
Drupal 7
- #2820962: Investigate random fail in d7 test
- #2762541: PHP 5.5 and 5.6 branch tests fail on Drupal 7 core, even though they pass when run on a patch
If your patch has an unexpected test failure
- Always click on the test results link to see what tests actually failed.
- Check the test results on https://www.drupal.org/node/3060/qa. If the same test appears to be failing on the "tested on commit" environments, HEAD may be broken.
- Most test failures are actually caused by bugs in patches. Even if a failure appears to be random, consider that the patch may be introducing the bug.
- If the test result says "CI error" or "CI aborted", that generally indicates an issue with the infrastructure and not with the patch. Wait a bit, then requeue the tests for the patch.
- If the test says "Fatal error" with no other information, click "View results on dispatcher", then "Console Output", then "Full log", and search on the page for "segmentation fault". #2859704: Intermittent segfaults on DrupalCI (some "did not complete due to a fatal error" with no additional info) is a known issue that may cause the test runner to report a fatal in different tests.
- If the test failure appears to be one of the above known failures, there is no need to add additional reports of it (unless the issue specifically requests so). Usually, once a fail is identified, Drupal.org maintainers can locate other, similar fails in server logs if needed. However, you should document on your issue which specific known issue caused the failure.
- If there is an unexpected test failure that is not covered by one of the above issues, file a new critical issue and add it to this issue's summary.