Skip to content

Support GCP models #609

@sukumargaonkar

Description

@sukumargaonkar

Description:
Support Models on GCP in ai-gateway. This includes Gemini models and Anthropic models hosted on GCP.
GCP google provided models like gemini as well as models from other provider like anthropic
Each provider has their own specific api with google specific authentication tweaks.

Some useful API features

  • Function calling
  • Guided Generation
  • Thinking/Reasoning related requests

[optional Relevant Links:]
Anthropic core api with some GCP's specific tweaks

Gemini Rest API: https://cloud.google.com/vertex-ai/generative-ai/docs/reference/rest/v1/projects.locations.endpoints/generateContent

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions