Define a backend for open webui

[aburlot]

Hello!

My company installed an Open WebUI instance that I would like to use. I do not have access to the ollama instance running background. Does anyone define a function like gptel-make-openai? My elisp level is a low and I am a bit lost in the definition.

[karthink]

I don't use Open WebUI so I can't test this, but from the docs it looks like something like this should work:

(gptel-make-openai "OpenWebUI"
  :host "localhost:3000"
  :protocol "http"
  :endpoint "/api/chat/completions"
  :stream t
  :models '(llama3.1))
  
(setq gptel-backend (gptel-get-backend "OpenWebUI")
      gptel-model 'llama3.1)

• Adjust the list of models as required.
• I don't know if it supports streaming, so you may need to remove the :stream t as well.

[aburlot]

Works like a charm. I missed the :stream t.