Skip to content

copilot-sdk executor does not materialize task-level context.fixture workspace #328

Description

@wryenmeek

Summary

With Waza 0.33.0 and the copilot-sdk executor, a task-level fixture declared as inputs.context.fixture does not appear to be copied into the task workspace. The agent starts in a fresh temp workspace and file discovery calls do not find the fixture files.

Minimal shape

# eval.yaml
name: fixture-copy-repro
skill: qa
config:
  executor: copilot-sdk
  model: claude-haiku-4.5
tasks:
  - "tasks/*.yaml"

# tasks/behavior-001.yaml
id: behavior-001
inputs:
  context:
    fixture: "fixtures/demo"
  prompt: "Inspect repository files with glob/read tools and summarize what you find."

Expected: files from fixtures/demo are available in the fresh task workspace, or Waza schema validation rejects inputs.context.fixture as unsupported.

Actual: the run creates a temp workspace, but tool calls report no usable fixture files. A downstream eval suite saw glob/view attempts against the temp workspace rather than copied fixture content.

Environment

  • Waza: 0.33.0
  • Executor: copilot-sdk
  • Model used for repro: claude-haiku-4.5

Downstream workaround

For now, downstream is wiring only one demonstration task to the fixture and is not blanket-migrating evals until fixture materialization is confirmed or documented as unsupported.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions