Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Pixtral] Add new model ; add vision #11231

Merged
merged 1 commit into from
Dec 11, 2024
Merged

Conversation

Asterovim
Copy link
Contributor

@Asterovim Asterovim commented Nov 30, 2024

Summary

This PR adds support for new Mistral AI models, specifically adding configuration for Pixtral models (pixtral-large-latest and pixtral-large-2411) to the model runtime. These models support vision and agent-thought features with a large context window of 128K tokens.

https://mistral.ai/fr/news/pixtral-large/

Changes include:

  • Added new models to _position.yaml
  • Created configuration files for pixtral-large-2411 and pixtral-large-latest
  • Models support vision and agent-thought capabilities
  • Configured with standard parameter rules (temperature, top_p, max_tokens, safe_prompt, random_seed)
  • Set pricing at $0.008/1K tokens for input and $0.024/1K tokens for output

Close #10896

Screenshots

Before: After:
No Pixtral large models available in model selection Pixtral large models available with vision capabilities

image

image

image

image

Checklist

  • This change requires a documentation update, included: Dify Document
  • I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • I've updated the documentation accordingly.
  • I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods

@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. ⚙️ feat:model-runtime labels Nov 30, 2024
@Asterovim
Copy link
Contributor Author

Original issue : #10896

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Dec 1, 2024
@crazywoola crazywoola requested a review from laipz8200 December 1, 2024 01:55
@crazywoola
Copy link
Member

cc @laipz8200

@crazywoola crazywoola merged commit 42d986b into langgenius:main Dec 11, 2024
5 checks passed
iamjoel pushed a commit that referenced this pull request Dec 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
⚙️ feat:model-runtime lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Pixtral Large (Mistral AI)
3 participants