This issue is intended as a tracking issue only to list all of the known intermittent test failures affecting Drupal core. Some issues are due to bugs in Drupal core; others may be due to issues with DrupalCI infrastructure.
Only open issues should be listed in the summary.
Consistent failures
Intermittent failures
- #3361121: [random test failure] InstallerExistingConfig[SyncDirectory]MultilingualTest::testConfigSync
- #2825845: DST-related test failures in FilterDateTimeTest
- #2920590: (canard?) Big Bos of Random Fails is ChainedFastBackend::markAsOutdated()
- #3041318: Various random fails due to mis-triggered Mink deprecation error
- #3143812: Random test failure Table 'sequences' already exists.
- #3191559: [random test failure] Random test fail in EntityReferenceWidgetTest
- #3210432: [random test failure] LayoutBuilderQuickEditTest::testQuickEditIgnoresDuplicateFields()
- #3203712: [random test failure] EntityDisplayTest::testExtraFields()
- #3207125: [random test failure] SettingsTrayBlockFormTest:: testEditModeEnableDisable()
Low fail rate or may be resolved
- #3057767: [random test failure] DialogTest::testDialog() (one failure in Jan. 2022, no others recently)
Investigation and hardening for past random failures
- #2936432: Review use of pressButton() in functional javascript tests in the Media module
- #2946294: Fix race conditions in OffCanvasTestBase
- #2856047: Avoid random failures in JavascriptTestBase when testing functionality in a dialog
- #3055983: Discover why there are occasional locks on SQLite in InlineBlockPrivateFilesTest::testPrivateFiles
- #3055982: Remove resizing window in BlockFormMessagesTest::testValidationMessage
- #3056848: Investigate LayoutBuilderDisableInteractionsTest random fails further
- #2571183: Deprecate random() usage in tests to avoid random test failures
- #3165263: Allow known flaky tests to be automatically repeated
If your patch has an unexpected test failure
- Always click on the test results link to see what tests actually failed.
- Check the test results on https://www.drupal.org/node/3060/qa. If the same test appears to be failing on the "tested on commit" environments, HEAD may be broken.
- Most test failures are actually caused by bugs in patches. Even if a failure appears to be random, consider that the patch may be introducing the bug.
- If the test result says "CI error" or "CI aborted", that generally indicates an issue with the infrastructure and not with the patch. Wait a bit, then requeue the tests for the patch.
- If the test says "Fatal error" with no other information, click "View results on dispatcher", then "Console Output", then "Full log", and search on the page for "segmentation fault". #2859704: Intermittent segfaults on DrupalCI (some "did not complete due to a fatal error" with no additional info) is a known issue that may cause the test runner to report a fatal in different tests.
- If the test failure appears to be one of the above known failures, there is no need to add additional reports of it (unless the issue specifically requests so). Usually, once a fail is identified, Drupal.org maintainers can locate other, similar fails in server logs if needed. However, you should document on your issue which specific known issue caused the failure.
- If there is an unexpected test failure that is not covered by one of the above issues, file a new critical issue and add it to this issue's summary.