Skip to content

language_models: Support fast mode on ChatGPT subscription provider#57436

Merged
tomhoule merged 2 commits into
mainfrom
tomhoule-wyvsqumvxtom
May 27, 2026
Merged

language_models: Support fast mode on ChatGPT subscription provider#57436
tomhoule merged 2 commits into
mainfrom
tomhoule-wyvsqumvxtom

Conversation

@tomhoule

@tomhoule tomhoule commented May 21, 2026

Copy link
Copy Markdown
Contributor

Same mechanism as for BYOK: service_tier == priority. Most of the work is already done. When validating this in manual testing, I noticed we get back service_tier == auto in the response, unlike in the regular OpenAI API scenario with BYOK, but apparently it doesn't mean priority tier wasn't applied. It's not a hard confirmation, but the model does seem to respond faster when I toggle fast mode on.

Release Notes:

  • Added Fast Mode (priority service tier) support to OpenAI models used through the ChatGPT subscription provider.

tomhoule added 2 commits May 21, 2026 17:11
Maps the existing `Speed::Fast` plumbing onto OpenAI's `service_tier:
"priority". Relevant docs [here](https://platform.openai.com/docs/api-reference/chat/create#chat-create-service_tier).

Like for the existing Anthropic fast mode we have a `Model::supports_priority`
method for the variants on openai.com/api-priority-processing. Pro, nano, and
legacy gpt-4 are excluded; Custom defaults to false.

This is gated to staff only for now, until we have the mechanism to require confirmation before you enable fast mode.
@cla-bot cla-bot Bot added the cla-signed The user has signed the Contributor License Agreement label May 21, 2026
@zed-community-bot zed-community-bot Bot added the staff Pull requests authored by a current member of Zed staff label May 21, 2026
@tomhoule tomhoule changed the title (WIP) language_models: Support fast mode on ChatGPT subscription provider language_models: Support fast mode on ChatGPT subscription provider May 22, 2026
@tomhoule tomhoule changed the base branch from main to tomhoule-uzqlqrtwuzwm May 22, 2026 09:21
@tomhoule tomhoule force-pushed the tomhoule-wyvsqumvxtom branch from b45d134 to e61ee34 Compare May 22, 2026 09:22
@tomhoule tomhoule marked this pull request as ready for review May 22, 2026 09:31
@bennetbo

Copy link
Copy Markdown
Member

We should probably add release notes, but looks good!

@tomhoule

Copy link
Copy Markdown
Contributor Author

Ah good catch! Fixing that.

Base automatically changed from tomhoule-uzqlqrtwuzwm to main May 27, 2026 09:21
@zed-industries-bot

Copy link
Copy Markdown
Contributor
Messages
📖

This PR includes links to the following GitHub Issues: #openai/codex#14204
If this PR aims to close an issue, please include a Closes #ISSUE line at the top of the PR body.

Generated by 🚫 dangerJS against e61ee34

@tomhoule tomhoule added this pull request to the merge queue May 27, 2026
Merged via the queue into main with commit a1d019b May 27, 2026
32 checks passed
@tomhoule tomhoule deleted the tomhoule-wyvsqumvxtom branch May 27, 2026 09:25
TomPlanche pushed a commit to TomPlanche/zed that referenced this pull request Jun 2, 2026
…ed-industries#57436)

Same mechanism as for BYOK: `service_tier == priority`. Most of the work
is already done. When validating this in manual testing, I noticed we
get back `service_tier == auto` in the response, unlike in the regular
OpenAI API scenario with BYOK, but apparently [it doesn't mean priority
tier wasn't
applied](openai/codex#14204 (comment)).
It's not a hard confirmation, but the model does seem to respond faster
when I toggle fast mode on.

Release Notes:

- Added Fast Mode (priority service tier) support to OpenAI models used
through the ChatGPT subscription provider.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed The user has signed the Contributor License Agreement staff Pull requests authored by a current member of Zed staff

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants