[META] Automatic routing for bulk

[kkewwei]

Please describe the end goal of this project

To improve indexing performance, we have deliberated automatic routing for bulk in #9219 and #4984. In our online log analysis scenario, these sub two optimizations have collectively improved bulk indexing performance by 20%+.

For log analysis scenario, operations like update, delete, upsert, update_by_query, delete_by_query, shrink, etc) are unnecessary, so we will implement Automatic routing for bulk based on Append only indices(introduced in #17039).

Please note, in scenarios with low indexing pressure, a potential 5% degradation in indexing performance may occur.

Co-authored-by: gaobinlong, itiyama

Issues

• [Feature Request] Phase1: support automatic routing for bulk #18305
• [Feature Request] Phase2: use adaptive shard selection in automatic routing for bulk #18306

Related component

No response

[andrross]

Catch All Triage - 1 2