Onboard MCP

[rithin-pullela-aws]

Description

We Onboard Model Context Protocol as an experimental feature with this PR.

• CX can create a new kind of connector called an MCP Connector to provide connection details about an MCP server.
• This MCP connector can be provided as an input to the agent.
• The user can also provide tool filters to filter out tools in the MCP connector.

Related Issues

Resolves #3660

Check List

• New functionality includes testing.
• New functionality has been documented.
• API changes companion pull request created.
• Commits are signed per the DCO using --signoff.
• Public documentation issue/PR created.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[codecov]

Codecov Report

Attention: Patch coverage is 10.59730% with 464 lines in your changes missing coverage. Please review.

Project coverage is 77.96%. Comparing base (9ffe7ef) to head (cb7ecd2).
Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
...g/opensearch/ml/common/connector/McpConnector.java	0.00%	213 Missing ⚠️
...nsearch/ml/engine/algorithms/agent/AgentUtils.java	13.76%	89 Missing and 5 partials ⚠️
...engine/algorithms/remote/McpConnectorExecutor.java	0.00%	61 Missing ⚠️
...ava/org/opensearch/ml/engine/tools/McpSseTool.java	0.00%	40 Missing ⚠️
...thms/agent/MLPlanExecuteAndReflectAgentRunner.java	0.00%	18 Missing ⚠️
...ava/org/opensearch/ml/common/agent/MLToolSpec.java	20.00%	11 Missing and 5 partials ⚠️
...on/transport/connector/MLCreateConnectorInput.java	45.83%	9 Missing and 4 partials ⚠️
.../action/register/TransportRegisterModelAction.java	0.00%	5 Missing ⚠️
.../ml/engine/algorithms/agent/MLChatAgentRunner.java	87.50%	2 Missing ⚠️
...orithms/agent/MLConversationalFlowAgentRunner.java	0.00%	2 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##               main    #3721      +/-   ##
============================================
- Coverage     79.07%   77.96%   -1.11%     
- Complexity     7116     7126      +10     
============================================
  Files           623      626       +3     
  Lines         31605    32103     +498     
  Branches       3579     3654      +75     
============================================
+ Hits          24991    25029      +38     
- Misses         5073     5519     +446     
- Partials       1541     1555      +14     

Flag	Coverage Δ
ml-commons	77.96% <10.59%> (-1.11%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[mingshl]

integ tests are passing but the code cov failed, would you address the code coverage?

codecov/patchFailing after 1s — 10.59% of diff hit (target 79.07%)

[jngz-es]

Let's merge it at first to catch up the release deadline.

[mingshl]

let's add a feature flag for this PR

[rithin-pullela-aws]

I will add feature flag for the MCP feature in another PR. Can we merge this one @mingshl