[AUTOCUT] Gradle Check Flaky Test Report for MetadataCreateIndexServiceTests

[opensearch-ci-bot]

Flaky Test Report for MetadataCreateIndexServiceTests

Noticed the MetadataCreateIndexServiceTests has some flaky, failing tests that failed during post-merge actions.

Details

Git Reference	Merged Pull Request	Build Details	Test Name
1673e74	17288	53215	org.opensearch.cluster.metadata.MetadataCreateIndexServiceTests.testCreateIndexWithContextDisabled
3f793b6	17252	53188	org.opensearch.cluster.metadata.MetadataCreateIndexServiceTests.testCreateIndexWithContextDisabled

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the MetadataCreateIndexServiceTests class are:

• 15471
• 15410
• 16962
• 17344
• 17295
• 17342
• 13525
• 14415
• 17165
• 17375
• 15404
• 16393
• 17255
• 17296
• 17306
• 17312
• 17313
• 17320
• 17325
• 17329
• 17333
• 17354
• 17370
• 17376

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

[rishabhmaurya]

Another failure - https://build.ci.opensearch.org/job/gradle-check/53286/

seed:

./gradlew ':server:test' --tests "org.opensearch.cluster.metadata.MetadataCreateIndexServiceTests.testCreateIndexWithContextDisabled" -Dtests.seed=86A37BB82FED4A6E -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=bho-Deva-IN -Dtests.timezone=America/Asuncion -Druntime.java=23

Unable to reproduce though locally.

@mgodwan since you added this test, do you mind taking a look. Thank you

[mgodwan]

This seems to be a side effect of tests running together, where some test is enabling the FF, and the current test relies on FF being disabled.
Will raise a PR to fix this.

[kkewwei]

It happens again in #17392(https://build.ci.opensearch.org/job/gradle-check/53681/) with the newest main branch.