Skip to content

feat(gateway): add per-agent token bucket or priority queue #25695

@discolotus

Description

@discolotus

Context

PR #25660 introduces single-gateway multi-agent routing as an MVP and explicitly leaves per-agent token budgeting / priority scheduling for follow-up.

Work

  • Add a per-agent token bucket, priority queue, or equivalent scheduler so one busy agent/profile cannot starve others.
  • Define default fairness behavior for the main profile and routed profiles.
  • Add regression tests for concurrent routed messages across multiple agents.

Source

Follow-up from #25660.

Referenced by #25660.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P3Low — cosmetic, nice to havecomp/gatewayGateway runner, session dispatch, deliverytype/featureNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions