Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✨ Added Anthropic and Groq support #684

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

devjpt23
Copy link
Contributor

Once this PR is merged, Anthropic and Groq models can be accessed via the IDE by changing the model in provider-settings.yaml. Below shows the way the file needs to be changed.


environment:
  ALWAYS_APPLIED_KEY: "envvar to be set regardless of which model is active"

# This is a collection of model configurations that may be used.  The `&active`
# anchor is used to reference the model to the active node below.  The extension will
# use the active node for configuration the kai-rpc-server.
models:
  ChatAnthropic:
    environment:
      ANTHROPIC_API_KEY: "YOUR_ANTHROPIC_API_KEY"

    provider: "ChatAnthropic"
    args:
      model: "claude-3-5-sonnet-20241022"

  
  ChatGroq: &active
    environment:
      GROQ_API_KEY: "YOUR_GROQ_API_KEY

    provider: "ChatGroq"
    args:
      model: "mixtral-8x7b-32768"

@devjpt23 devjpt23 marked this pull request as draft February 24, 2025 03:09
@devjpt23 devjpt23 force-pushed the agents branch 2 times, most recently from 55c1299 to d42e2c7 Compare February 24, 2025 15:12
@jwmatthews
Copy link
Member

@devjpt23 we will likely want to bring in #675 first and then your PR after it’s ready and tested.

It would be worth you taking a look at #675 and being familiar, we think the continuation support may be the fix to problems we’ve seen working with Claude and other models via Amazon bedrock in past.

@devjpt23 devjpt23 force-pushed the agents branch 2 times, most recently from b99dd1d to 81a7ee9 Compare February 27, 2025 03:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants