Summary
Add a new section to the waza docs site (site/src/content/docs/guides/) covering how to use waza in CI/CD pipelines across GitHub Actions and Azure DevOps.
Motivation
Waza users need clear guidance on integrating evals and token checks into their CI workflows. Currently there's no docs page showing how to install waza, run evals, and gate PRs in automated pipelines. This is a common first question from teams adopting waza.
Proposed Content
Guide: ci-integration.mdx
1. Installing waza in CI
- Via azd extension (recommended):
azd ext install microsoft.azd.waza
- Via binary download (alternative)
2. GitHub Actions
- Running evals on PR (
azd waza run)
- Token budget checks (
waza tokens check / waza tokens diff)
- Uploading results as artifacts
- Pass/fail gating with thresholds
- Example workflow file
3. Azure DevOps Pipelines
- Same capabilities adapted for ADO YAML syntax
- Pipeline task examples
- Artifact publishing
4. GitLab CI (brief)
- Minimal example showing portability
5. Best Practices
- When to run evals (on skill changes only vs. every PR)
- Path filters to avoid unnecessary runs
- Caching waza installation
- Handling eval failures (informational vs. blocking)
Reference
The GitHub Copilot for Azure team already has a working GitHub Actions integration:
`yaml
Their pattern (from .github/workflows/eval.yml)
This should be generalized and documented for all waza users.
Acceptance Criteria
Labels
enhancement, docs, priority:p1
Summary
Add a new section to the waza docs site (site/src/content/docs/guides/) covering how to use waza in CI/CD pipelines across GitHub Actions and Azure DevOps.
Motivation
Waza users need clear guidance on integrating evals and token checks into their CI workflows. Currently there's no docs page showing how to install waza, run evals, and gate PRs in automated pipelines. This is a common first question from teams adopting waza.
Proposed Content
Guide:
ci-integration.mdx1. Installing waza in CI
azd ext install microsoft.azd.waza2. GitHub Actions
azd waza run)waza tokens check/waza tokens diff)3. Azure DevOps Pipelines
4. GitLab CI (brief)
5. Best Practices
Reference
The GitHub Copilot for Azure team already has a working GitHub Actions integration:
`yaml
Their pattern (from .github/workflows/eval.yml)
azd config set alpha.extensions on
azd ext source add -n waza -t url -l https://raw.githubusercontent.com/microsoft/waza/main/registry.json
azd ext install microsoft.azd.waza
`
This should be generalized and documented for all waza users.
Acceptance Criteria
site/src/content/docs/guides/ci-integration.mdxcd site && npm run buildLabels
enhancement, docs, priority:p1