-
Notifications
You must be signed in to change notification settings - Fork 199
Labels
Milestone
Description
Description:
Support Models on GCP in ai-gateway. This includes Gemini models and Anthropic models hosted on GCP.
GCP google provided models like gemini as well as models from other provider like anthropic
Each provider has their own specific api with google specific authentication tweaks.
Some useful API features
- Function calling
- Guided Generation
- Thinking/Reasoning related requests
[optional Relevant Links:]
Anthropic core api with some GCP's specific tweaks
Gemini Rest API: https://cloud.google.com/vertex-ai/generative-ai/docs/reference/rest/v1/projects.locations.endpoints/generateContent
Reactions are currently unavailable