-
Notifications
You must be signed in to change notification settings - Fork 0
feat: Providers page -- usage metrics (total tokens, cost) and model capabilities display #894
Copy link
Copy link
Closed
Labels
prio:mediumShould do, but not blockingShould do, but not blockingspec:providersDESIGN_SPEC Section 9 - Model Provider LayerDESIGN_SPEC Section 9 - Model Provider Layertype:featureNew feature implementationNew feature implementationv0.5Minor version v0.5Minor version v0.5v0.5.2Patch release v0.5.2Patch release v0.5.2
Description
Follow-up from #785
The Providers page (#785, PR #893) shipped health metrics (calls/24h, response time, error rate) but two scope items need backend model changes:
1. Usage metrics: total tokens and cost per provider
Issue #785 specifies "calls in last 24h, total tokens, cost per provider" as usage metrics. Only calls/24h is implemented.
Required changes:
- Add
total_tokens_24handtotal_cost_24hfields toProviderHealthSummary(backend) - Wire these into the health tracking aggregation pipeline
- Display in
ProviderHealthMetrics.tsxandProviderCard.tsx(frontend)
2. Model capabilities display
Issue #785 specifies "available models per provider with capabilities". Models are listed with ID, alias, context, and pricing -- but capabilities (vision, tools, streaming) are not shown.
Required changes:
- Add capabilities fields to
ProviderModelConfig(or surface fromModelCapabilitiesin the driver layer) - Expose in the
GET /providers/{name}/modelsresponse - Display capability badges in
ProviderModelList.tsx(frontend)
Labels
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
prio:mediumShould do, but not blockingShould do, but not blockingspec:providersDESIGN_SPEC Section 9 - Model Provider LayerDESIGN_SPEC Section 9 - Model Provider Layertype:featureNew feature implementationNew feature implementationv0.5Minor version v0.5Minor version v0.5v0.5.2Patch release v0.5.2Patch release v0.5.2