Sync ci-analysis skill from lewing/agent-plugins#125149
Sync ci-analysis skill from lewing/agent-plugins#125149danmoseley wants to merge 1 commit intodotnet:mainfrom
Conversation
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
I didn't test this PR, but it was part of #125005 which I abandoned, but it was used when testing that. Updating this so triage skills work in this repo can use the latest. |
There was a problem hiding this comment.
Pull request overview
Syncs the .github/skills/ci-analysis skill documentation to match the current version from lewing/agent-plugins, clarifying when the skill should/shouldn’t be used and adding dedicated reference docs for workflow, failure interpretation, and recommendation output.
Changes:
- Updated
SKILL.mdto add negative routing guidance, service-access guidance (MCP vs CLI), and to condense/relocate parameter + workflow details into references. - Added new reference docs covering the end-to-end workflow, CI failure interpretation, recommendation generation guidance, and script operating modes.
- Refined existing reference docs (AzDO org selection guidance; Helix log/artifact search guidance; delegation patterns for recovery).
Reviewed changes
Copilot reviewed 8 out of 8 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
| .github/skills/ci-analysis/SKILL.md | Restructures and tightens the skill’s usage guidance; links out to reference docs for details. |
| .github/skills/ci-analysis/references/analysis-workflow.md | Adds an end-to-end workflow (Steps 1–3) for CI analysis after context gathering. |
| .github/skills/ci-analysis/references/failure-interpretation.md | Adds a guide for classifying CI outcomes and handling canceled/timeout/crash recovery. |
| .github/skills/ci-analysis/references/recommendation-generation.md | Adds guidance for synthesizing actionable recommendations from [CI_ANALYSIS_SUMMARY]. |
| .github/skills/ci-analysis/references/script-modes.md | Documents script modes and key parameters for PR/build/Helix-job based analysis. |
| .github/skills/ci-analysis/references/azdo-helix-reference.md | Updates guidance for choosing the correct AzDO org/tools based on build URLs. |
| .github/skills/ci-analysis/references/delegation-patterns.md | Refines recovery delegation steps to incorporate MCP tool behavior and faster searching. |
| .github/skills/ci-analysis/references/manual-investigation.md | Adds remote Helix search guidance via MCP tools and clarifies MCP-first approach. |
|
If you use the plugin you also get lewing/helix.mcp configured, which makes it work substantially better. |
|
Meaning you think we should delete this from the repo and especially add a pointer to your repo? |
|
there is also a copy from a different point here https://github.com/dotnet/aspnetcore/tree/main/.github/skills/ci-analysis |
|
@jkotas how do we feel about pointing to individuals' repos |
It sounds like a security problem to me. If you want to do that, Barry needs to sign off on it. |
|
I'd prefer we have a proper shared place for all of it but I'm not holding my breath. |
|
https://github.com/dotnet/arcade/ is the place for shared eng infra. |
dotnet/arcade is not a plugin marketplace |
|
let's move this conversation to dotnet/arcade#16567 where I've now shared some more complete thoughts. |
|
moving to the new shared repo |
Syncs the ci-analysis skill to match the current version in lewing/agent-plugins. No local modifications.
Changes
SKILL.md
New reference docs
analysis-workflow.md— end-to-end analysis workflow stepsfailure-interpretation.md— patterns for classifying CI failuresrecommendation-generation.md— guidance for generating actionable recommendationsscript-modes.md— Get-CIStatus.ps1 operating modes and flag combinationsUpdated reference docs
azdo-helix-reference.md,delegation-patterns.md,manual-investigation.md— minor refinements