Fixing a test flake by making waitForDisconnect wait for disconnect#1231
Closed
alyssawilk wants to merge 7 commits intoenvoyproxy:masterfrom
Closed
Fixing a test flake by making waitForDisconnect wait for disconnect#1231alyssawilk wants to merge 7 commits intoenvoyproxy:masterfrom
alyssawilk wants to merge 7 commits intoenvoyproxy:masterfrom
Conversation
rshriram
pushed a commit
to rshriram/envoy
that referenced
this pull request
Oct 30, 2018
Automatic merge from submit-queue. [BOT PR] to update dependencies of proxy This PR will be merged automatically once checks are successful. ```release-note none ```
nezdolik
pushed a commit
to nezdolik/envoy
that referenced
this pull request
May 4, 2024
Fix implicit-int-float-conversion warning.
mathetake
pushed a commit
that referenced
this pull request
Mar 3, 2026
**Description** This PR adds OpenAI's legacy `/completions` endpoint support to Envoy AI Gateway, enabling compatibility with models like `babbage-002` and `gpt-3.5-turbo-instruct`. Ideal for cost-optimized or fine-tuned setups (e.g., vLLM/llama.cpp) needing suffix params or token prompts. Refactored unions (`ContentUnion`, `EmbeddingRequestInput`, `PromptUnion`) with custom unmarshaling for **1.6x–10x speedups**, **60%–95% less memory**, and **52%–93% fewer allocations** vs. openai-go. Gains are critical for batch/token-heavy workloads. *Key Changes* - New types: `CompletionRequest`, `CompletionResponse`, `PromptUnion`. - Model constants for legacy testing. - Unified `Usage` across APIs. - New Benchmarks! **Related Issues/PRs** Starts #1231 --------- Signed-off-by: Adrian Cole <adrian@tetrate.io>
mathetake
pushed a commit
that referenced
this pull request
Mar 3, 2026
**Description** This adds end-to-end support for pass through openai /completions. A follow-up will add observability and close out the feature. **Related Issues/PRs** Continues #1231 Signed-off-by: Adrian Cole <adrian@tetrate.io>
mathetake
pushed a commit
that referenced
this pull request
Mar 3, 2026
) **Description** This completes metrics and tracing and updates docs. So, now /v1/completions is complete! **Related Issues/PRs (if applicable)** Fixes #1231 --------- Signed-off-by: Adrian Cole <adrian@tetrate.io>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.