Available skills
zeroeval-install
Installs the SDK (Python or TypeScript), verifies your first trace, migrates prompts to
ze.prompt, and recommends starter judges. Routes to custom-tracing for non-SDK languages.custom-tracing
Send traces to ZeroEval without the SDK. Covers direct REST API ingestion (
POST /spans) and OpenTelemetry (OTLP) export for any language.create-judge
Helps you pick an evaluation type (binary or scored), write a judge template, define criteria, and create the judge via dashboard or API.
prompt-migration
Migrates hardcoded prompts to
ze.prompt, wires feedback collection, connects judges, and walks through the staged rollout to prompt optimization.Install
On Windows without symlink support, use
npx skills or the manual copy method. The plugins/ directory in the repo contains symlinks that may not resolve on Windows.Requirements
- A ZeroEval account and API key — zeroeval.com
- SDK path (zeroeval-install): Python 3.8+ or Node 18+, plus an LLM provider SDK (OpenAI, Vercel AI, LangChain, etc.)
- Direct API / OTLP path (custom-tracing): any language with an HTTP client or OpenTelemetry exporter
After installation
Once installed, your coding agent picks up the skills automatically. Ask it to “set up zeroeval”, “send traces via API”, “create a judge”, or “migrate my prompts to ze.prompt” and it will use them. If you want to read the product docs directly:Tracing quickstart
Get your first trace in under 5 minutes
Prompt setup
Add ze.prompt() to your Python or TypeScript codebase
Judges
How calibrated judges evaluate your production traffic
Judge setup
Create and calibrate a judge