[Feature Request]: Enabling 'Parts' for Gemini Requests to Google, to make use of Multi-Modal GCP features

[mattbeard0out]

Is your feature request related to a problem? Please describe.

Gemini models hosted on Google Cloud Services offer options of including 'Parts' in messages, for multi-modal interaction. This includes directly linking to Google Buckets, without the need to have the model fetch it themselves, becoming more deterministic.

This is missing from AG2, with no support for files as Parts as part of the framework.

Describe the solution you'd like

For Gemini models, users should be able to use Parts from google types python package, to construct messages. This is important for enterprise could deployments.

Additional context

From Model Garden on Google

[pasindu-pr]

@mattbeard0 Thanks for opening this feature request. Google GenAI also provides a separate file upload feature, which you can check out here:https://ai.google.dev/api/files

[mattbeard0]

@mattbeard0 Thanks for opening this feature request. Google GenAI also provides a separate file upload feature, which you can check out here:https://ai.google.dev/api/files

Thanks, this is good, but might not be aligned with instances where files already exist in GCS.