)

This reverts commit 0e0eefbb009c111a025a96441cbf05ef3150a144.

Merge from envoyproxy/envoy-wasm:master

Signed-off-by: Matt Klein <mklein@lyft.com>
Signed-off-by: JP Simard <jp@jpsim.com>

Signed-off-by: Matt Klein <mklein@lyft.com>
Signed-off-by: JP Simard <jp@jpsim.com>

Per #90, we will migrate to dynamic modules in the second or third
version of
AI Gateway, the public configuration package must not be coupled with
extproc (see the description in the issue). This renames `extprocconfig`
to more generic (and accurate) name as `filterconfig`.

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This decouples backendauth & headermutator packages from extproc
specifics. As we are looking to migrate to dynamic modules, this is a
necessary refactoring work to make the code as reusable as possible.

**Related Issues/PRs (if applicable)**

Preliminary for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**
The translators shouldn't have to be tied with ext_proc APIs since it's
none of their concerns. This commit decouples the translator package
from them so that we can easily use them in dynamic modules too.

**Related Issues/PRs (if applicable)**

Preparation for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This moves the non-extproc related packages (extproc and bodymutator)
out of internal/extproc directory into directly under internal dir.

**Related Issues/PRs (if applicable)**

Preparation for #90

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This decouples the filter config watcher from the extproc package as
it's already solely operating on the filterapi package.

**Related Issues/PRs (if applicable)**

Preparation for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This commit decouples "runtime filter config" that is derived from the
filterapi.Config to be able to reuse the code in dynamic modules port
#90.

**Related Issues/PRs (if applicable)**

Preparation for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This fixes the inconsistency for embeddings in the span usage in
translators.

**Related Issues/PRs (if applicable)**
Preparation for #90
Follow up on #1565

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

#1568)

**Description**

This fixes the inconsistency of span usage by image gen and rerank
translators

**Related Issues/PRs (if applicable)**
Preparation for #90 
Follow up on #1565 #1567

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This consolidates all metrics interfaces into one interface as they are
almost all copy and pasted from each other.

**Related Issues/PRs (if applicable)**

Preparation for #90

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This removes all the duplicated copy-and-pasted code in tracing but
having generic interfaces and implementations, and simply instantiating
them for each endpoint. This helps reduce the necessary code when adding
a new endpoint since now the "recorder" implementation is the only
endpoint specific implementation.


**Related Issues/PRs (if applicable)**

Preparation for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

…tor (#1583)

**Description**

This moves translator.LLMTokenUsage struct into metrics package from
translator package to make sure that all call site of metrics interface
uses the same signature by simply passing the cost info from translator.
This will help unify all the per-endpoint implementation detail.

**Related Issues/PRs (if applicable)**

Preparation for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**
This consolidates all the copy-pasted processors that existed per
endpoint we support into one generic processor. This was made possible
thanks to the series of refactoring that we landed in the past few weeks
primarily for dynamic module work #90.

Notably, now in order to add an endpoint, majority of the new code will
be in translator (where also have shared generic interface) as well as
the type definition. No longer it requires the huge copy paste of
processors.

**Related Issues/PRs (if applicable)**

Resolves #1083 
Blocker for #1429 #1584 #1592 #1594

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>
Co-authored-by: Ignasi Barrera <ignasi@tetrate.io>

)

**Description**

This adds various test cases with the request/response pair being small,
medium and large


**Related Issues/PRs (if applicable)**

Preparation for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>

**Description**

This refactors tests/extproc integration tests:
1. Renamed as tests/data-plane to be usable for Dynamic Module too #1564
2. Extract tests/extproc/mcp into tests/data-plane-mcp to have a
separate concern in each integration tests

**Related Issues/PRs (if applicable)**

Preparation for #90

---------

Signed-off-by: Takeshi Yoneda <t.y.mathetake@gmail.com>