Description:

Since we have a clearly separated interface between External Processor and K8s/EG specific knowledge, it should be straightforward to provide the standalone CLI or Docker image that can be run locally by users on Mac or Linux distributions.

In fact, there's already external processing stand alone end-to-end tests in tests/extproc which doesn't require any k8s/EG setup. So it should be easy to create one.

This will drive the adoption of the project as well as our development since the majority of future features like prompt guard, etc should be independent of the platform, and it would be nice to allow developers to iterate on it without the heavy setups etc.

[optional Relevant Links:]

Any extra documentation required to understand the issue.