Skip to content

[Feat]: Samples allowed for Custom Model URLs #611

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
1 task done
jland-redhat opened this issue May 20, 2025 · 1 comment
Open
1 task done

[Feat]: Samples allowed for Custom Model URLs #611

jland-redhat opened this issue May 20, 2025 · 1 comment

Comments

@jland-redhat
Copy link

Is your feature request related to a problem? Please describe.

I am setting up an Active-to-Active (A2A) demo environment. I have an existing vLLM deployment with a model accessible within this environment.

The current A2A samples in this repository appear to be primarily designed for use with Gemini models. While I understand this may not be the central focus of the samples, it would be nice to be able to simplify it for users like myself who wish to quickly show a demo with the services integrated to their own enterprise models or alternative large language models (LLMs) other than Gemini.

Describe the solution you'd like

I think it would be nice and relatively easy adding a small amount of additional logic to the A2A samples to allow for more flexible model endpoint configuration. Specifically, it would be beneficial to support the inclusion of OPENAI_URL and OPENAI_TOKEN environment variables. If these variables are present and a Gemini API key is not found, the samples should ideally default to using the specified OpenAI-compatible endpoint. This would significantly ease the deployment and testing of A2A scenarios with custom or self-hosted LLMs.

Describe alternatives you've considered

No response

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@flystar32
Copy link

As I've mentioned on #330 (comment)
it's works for me,wish it can help you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants