Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: microsoft/waza
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.29.0
Choose a base ref
...
head repository: microsoft/waza
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: v0.30.0
Choose a head ref
  • 2 commits
  • 16 files changed
  • 2 contributors

Commits on Apr 22, 2026

  1. feat: add waza quality command — LLM-as-Judge skill quality scoring (… 

    …#218)

* feat: add `waza quality` command — LLM-as-Judge skill quality scoring #98

Add `waza quality <skill-path>` command that uses an LLM to evaluate
skill content quality across five dimensions:

- clarity: instruction clarity and structure
- completeness: coverage of edge cases and detail level
- trigger_precision: USE FOR / DO NOT USE FOR definition quality
- scope_coverage: boundary clarity and capability explicitness
- anti_patterns: avoidance of vague/conflicting instructions

Implementation:
- internal/quality/rubric.go: dimension definitions and validation
- internal/quality/judge.go: prompt construction, LLM execution, response parsing
- internal/quality/report.go: table and JSON output formatting
- cmd/waza/cmd_quality.go: CLI command with --model, --format, --rubric flags
- 28 tests covering rubric validation, judge execution, response parsing,
  report formatting, auth errors, and edge cases
- Documentation in README.md and site CLI reference

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix: gofmt + staticcheck lint violations in quality package

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix: gofmt + errcheck violations in scope_reduction package

- Apply gofmt formatting to scope_reduction.go (struct alignment, blank line)
- Apply gofmt formatting to scope_reduction_test.go (struct alignment)
- Fix errcheck: use comma-ok form for all type assertions

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
    @spboyer
    spboyer and Copilot authored Apr 22, 2026
    Configuration menu
    Copy the full SHA
    c473b41 View commit details
    Browse the repository at this point in the history

  2. feat: add scope-reduction advisory check to waza check (#219) 

    * feat: add scope-reduction advisory check to waza check #183

Add a new advisory checker (scope-reduction) that parses SKILL.md for
capability signals — USE FOR phrases, level-2 headings, and numbered
step sequences — and warns when few are detected, suggesting possible
token-limit compression loss.

- ScopeReductionChecker with configurable MinCapabilities threshold
- 13 unit tests covering all signal types and edge cases
- Updated display and loop tests for new advisory output line
- Added documentation in CLI reference (site/)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* fix: gofmt formatting and errcheck type assertions in scope-reduction

- Run gofmt on scope_reduction.go and scope_reduction_test.go
- Fix unchecked type assertions (errcheck check-type-assertions: true)
  Use two-value form with require.True(t, ok) throughout test file
- Remove extra blank line between variable declarations

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
    @spboyer
    spboyer and Copilot authored Apr 22, 2026
    Configuration menu
    Copy the full SHA
    6aaebec View commit details
    Browse the repository at this point in the history
Loading