Skip to content

Add GPUStack as a Model Provider in Dify #9935

@gitlawr

Description

@gitlawr

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

GPUStack is an open-source GPU cluster manager for running LLMs. We would like to use GPUStack as a model provider in Dify.

2. Additional context or comments

GPUStack provides both OpenAI compatible APIs (Models / Chat Completions / Embeddings) and other APIs like Rerank.

3. Can you help us with this feature?

  • I am interested in contributing to this feature.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions