Skip to content

feat: include instruction files in eval runs#248

Merged
github-actions[bot] merged 1 commit into
mainfrom
spboyer/include-instructions-md-files
May 20, 2026
Merged

feat: include instruction files in eval runs#248
github-actions[bot] merged 1 commit into
mainfrom
spboyer/include-instructions-md-files

Conversation

@spboyer

@spboyer spboyer commented May 20, 2026

Copy link
Copy Markdown
Member

Summary

  • Add eval-level config.instruction_files and task-level instruction_files YAML support
  • Copy listed instruction files from the active fixtures/context directory into each task workspace
  • Append path-labeled instruction file contents to the Copilot system message during execution
  • Update schemas, docs, and regression tests

Closes #239

⚠️ This task was flagged as "needs review" — please have a squad member review before merging.

Validation

  • go test ./...
  • cd site && npm run build

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions github-actions Bot enabled auto-merge (squash) May 20, 2026 16:48
@github-actions github-actions Bot merged commit 0869b05 into main May 20, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Feature Request: Include instructions.md files during test execution

1 participant