Skip to content

[Feature Request] Explain System Ingest Pipeline #18253

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
bzhangam opened this issue May 9, 2025 · 1 comment
Open

[Feature Request] Explain System Ingest Pipeline #18253

bzhangam opened this issue May 9, 2025 · 1 comment
Labels
enhancement Enhancement or improvement to existing feature or request Indexing Indexing, Bulk Indexing and anything related to indexing

Comments

@bzhangam
Copy link
Contributor

bzhangam commented May 9, 2025

Is your feature request related to a problem? Please describe

This is an follow up item for the system ingest pipeline feature. The system ingest pipeline is a feature to allow plugins to systematically add ingest processors based on the index mapping. The system ingest pipeline is invisible to users and it's not easy for them to understand what system ingest processors are included in the system ingest pipeline and how it works.

Describe the solution you'd like

We may want to create a new API to support explaining the system ingest pipeline. The input can be the index configuration and the output will include what system ingest processors will be created in the system ingest pipeline. Also can include the info of the function of the system ingest processors.

Related component

Indexing

Describe alternatives you've considered

No response

Additional context

The system ingest pipeline is introduced by this #17817

And for now we only have one system ingest processor supported by the neural plugin.

@bzhangam bzhangam added enhancement Enhancement or improvement to existing feature or request untriaged labels May 9, 2025
@github-actions github-actions bot added the Indexing Indexing, Bulk Indexing and anything related to indexing label May 9, 2025
@krisfreedain
Copy link
Member

Catch All Triage - 1 2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request Indexing Indexing, Bulk Indexing and anything related to indexing
Projects
None yet
Development

No branches or pull requests

2 participants