Skip to content

[model-gateway] add ModelCard support to WorkerMetadata#14243

Merged
slin1237 merged 1 commit intomainfrom
oai-router-n/4
Dec 1, 2025
Merged

[model-gateway] add ModelCard support to WorkerMetadata#14243
slin1237 merged 1 commit intomainfrom
oai-router-n/4

Conversation

@slin1237
Copy link
Copy Markdown
Collaborator

@slin1237 slin1237 commented Dec 1, 2025

Summary

Extends WorkerMetadata with model configuration fields to enable per-model routing and provider selection.

Changes

New fields:

  • models: Vec - models this worker can serve
  • default_provider: Option - fallback provider
  • default_model_type: ModelType - fallback capabilities

New WorkerMetadata methods:

  • find_model() - lookup by ID or alias
  • supports_model() - check if worker serves a model
  • supports_endpoint() - check endpoint support per model
  • provider_for_model() - get provider for a model
  • model_ids() - iterate over model IDs

Checklist

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@slin1237 slin1237 added the run-ci label Dec 1, 2025
@slin1237 slin1237 merged commit e7d6027 into main Dec 1, 2025
64 checks passed
@slin1237 slin1237 deleted the oai-router-n/4 branch December 1, 2025 21:04
harvenstar pushed a commit to harvenstar/sglang that referenced this pull request Dec 4, 2025
tonyluj pushed a commit to openanolis/sglang that referenced this pull request Dec 5, 2025
yuchengz816-bot pushed a commit to yuchengz816-bot/sglang that referenced this pull request Dec 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant