Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

[Backport 5.1] cody-gateway, sourcegraph: disable code completions for OpenAI (#55624)#55689

Merged
bobheadxi merged 4 commits into
5.1from
backport-55624-to-5.1
Aug 9, 2023
Merged

[Backport 5.1] cody-gateway, sourcegraph: disable code completions for OpenAI (#55624)#55689
bobheadxi merged 4 commits into
5.1from
backport-55624-to-5.1

Conversation

@bobheadxi

Copy link
Copy Markdown
Member

Backport of #55624, created manually


Using OpenAI for Cody code completions is currently untested and unsupported. Despite this, we have at least one customer generating very large numbers of OpenAI code completions
requests

This change:

  • Makes Cody Gateway reject OpenAI code completions requests (responding with 501 not implemented)
  • Prevents Sourcegraph from generating OpenAI code completion requests

CI


Co-authored-by: Erik Seliger erikseliger@me.com
(cherry picked from commit 151f43f)

Test plan

Using OpenAI for Cody code completions is currently [untested and
unsupported](https://sourcegraph.slack.com/archives/CN4FC7XT4/p1690986792111129?thread_ts=1690931810.610299&cid=CN4FC7XT4).
Despite this, we have [at least one customer generating very large
numbers of OpenAI code completions
requests](https://sourcegraph.slack.com/archives/C03JR7S7KRP/p1691438665847449?thread_ts=1689373762.522179&cid=C03JR7S7KRP)
- enough to get us [rate limited by
OpenAI](https://sourcegraph.sentry.io/issues/4372449189/?alert_rule_id=14416305&alert_type=issue&project=4505201451270144).

This change:

- Makes Cody Gateway reject OpenAI code completions requests (responding
with 501 not implemented)
- Prevents Sourcegraph from generating OpenAI code completion requests

CI

---------

Co-authored-by: Erik Seliger <erikseliger@me.com>
(cherry picked from commit 151f43f)
@bobheadxi bobheadxi requested review from a team, eseliger and philipp-spiess August 9, 2023 19:10
@cla-bot cla-bot Bot added the cla-signed label Aug 9, 2023
@sourcegraph-bot

sourcegraph-bot commented Aug 9, 2023

Copy link
Copy Markdown
Contributor

📖 Storybook live preview

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants