Skip to content

Add API Key Passthrough for Gemini #1869

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
yeldarby merged 6 commits into from
Jan 6, 2026
Merged

Add API Key Passthrough for Gemini #1869

yeldarby merged 6 commits into from
Jan 6, 2026
+979 −0

Conversation

@yeldarby
Copy link
Contributor

@yeldarby yeldarby commented Jan 3, 2026 •
edited
Loading

Description

Adds Google Gemini Block v3 with API key passthrough support. Users can now either:

  • Use Roboflow's managed API key (rf_key:account) which proxies requests through Roboflow API with usage-based billing
  • Provide their own Google AI API key for direct access

Also adds support for newer Gemini models (Gemini 3 Pro, 2.5 Pro/Flash/Flash-Lite, 2.0 Flash/Flash-Lite) and thinking_level parameter for Gemini 3+ models.

Type of change

  • New feature (non-breaking change which adds functionality)

How has this change been tested, please provide a testcase or example of how you tested the change?

  • Tested with both direct Google API key and Roboflow managed key modes
  • Verified model aliases are properly resolved
  • Tested various task types (unconstrained, classification, VQA, etc.)

Any specific deployment considerations

  • Requires Roboflow API proxy endpoint (apiproxy/gemini) to be available for managed key mode

Docs

  • Docs updated? What were the changes:

@codeflash-ai codeflash-ai bot mentioned this pull request Jan 4, 2026
Closed
@codeflash-ai
Copy link
Contributor

codeflash-ai bot commented Jan 4, 2026

⚡️ Codeflash found optimizations for this PR

📄 10% (0.10x) speedup for prepare_object_detection_prompt in inference/core/workflows/core_steps/models/foundation/google_gemini/v3.py

⏱️ Runtime : 206 microseconds → 187 microseconds (best of 250 runs)

A dependent PR with the suggested changes has been created. Please review:

If you approve, it will be merged into this PR (branch api-key-passthrough/gemini).

Static Badge

@yeldarby yeldarby marked this pull request as ready for review January 5, 2026 21:35
@yeldarby yeldarby merged commit 3a70cd2 into main Jan 6, 2026
51 checks passed
@yeldarby yeldarby deleted the api-key-passthrough/gemini branch January 6, 2026 03:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@grzegorz-roboflow grzegorz-roboflow grzegorz-roboflow approved these changes

@PawelPeczek-Roboflow PawelPeczek-Roboflow Awaiting requested review from PawelPeczek-Roboflow PawelPeczek-Roboflow is a code owner

@probicheaux probicheaux Awaiting requested review from probicheaux probicheaux is a code owner

@hansent hansent Awaiting requested review from hansent hansent is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@yeldarby @grzegorz-roboflow