webRTC support with Ephimeral Token

[smhnkmr]

Description of the feature request:

I am using OpenAI Realtime API, and I could directly connect the client with OpenAI server using webRTC and ephemeral token. Whereas, in gemini live API, I have to setup the websocket proxy server and websocket browser client to do the same.

I would really like to have the gemini live API support direct webRTC connection similar to OpenAI. This way the latency and scalability issues are very well addressed. also, I don't have to worry about signaling server needs if it is directly supported by gemini.

What problem are you trying to solve with this feature?

latency, reliable and scalable way of building apps using gemini live API, through webRTC implementations.

Any other information you'd like to share?

No response

[muhllys]

Yes this is a must have feature for sure. I'm currently using WebRTC providers like Daily, but if this was part of the live API, would cut our Daily costs at least.

[gsogol]

Any updates? Websockets are terribly slow. OpenAI's Realtime API supports WebRTC already since they hired the WebRTC creator. Would be a wonderful feature. 🙏

cc @hapticdata

[vishnukool]

Any updates? I

It's honestly embarrassing as Google, your demo example encourages putting Gemini API key in the frontend. It's a huge security vulnerability.

[R3n3gade-ai]

use this https://github.com/GoogleCloudPlatform/generative-ai/tree/main/gemini/sample-apps/gemini-quart-cloudrun