Configure "temperature" and other parameters for BYOK (Bring Your Own Key or model) #155862
Unanswered
insilications
asked this question in
Copilot
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Select Topic Area
Question
Body
It would be nice to have the ability to add custom parameters for BYOK models. Perhaps even some type of "addParams" key where the user can add custom parameters to be sent to all requests in a particular endpoint or model. The current iteration of BYOK is somewhat limited in this regard. Being able to set the "temperature" can be very important for some models and use cases.
Beta Was this translation helpful? Give feedback.
All reactions