Skip to content

test(playbook): gonka gateway live scenarios + coverage-status row #3606

@bug-ops

Description

@bug-ops

Part of epic #3602.

Scope

Add live-test playbook for the gateway provider plus a coverage-status row, satisfying CLAUDE.md points 6 and 7 for new functionality.

Files to create / modify

  • .local/testing/playbooks/gonka-gateway.md (new) — five scenarios:
    1. Fresh install + age vault: zeph init → pick gateway → vault set → first chat prompt.
    2. Switch from existing OpenAI provider via /provider gonkagate runtime command.
    3. Streaming a long response — verify token-by-token output equivalence with OpenAI streaming.
    4. Wrong API key returns LlmError::ApiError { status: 401 } with clear message.
    5. Embeddings unsupported on GonkaGate as of writing — wizard does not prompt for embedding_model; provider.supports_embeddings() returns false.
  • .local/testing/coverage-status.md — new row Gonka gateway provider with status Untested (linked to the new playbook).

Acceptance

  • Playbook is structured per project conventions (see existing playbooks under .local/testing/playbooks/).
  • Coverage-status row added in alphabetical position with link to playbook.
  • A live CI cycle exercises at least scenarios 1 and 4 and updates the row to Tested or Partial.

Depends on

#2, #3 (wizard + default.toml must exist for scenarios to be executable).

Size

S (~1h)

Metadata

Metadata

Assignees

Labels

P3Research — medium-high complexitysize/SSmall PR (11-50 lines)testingTests and qualitytestsTest-related changes

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions