[WHM] Workflow Health Dashboard — 2026-04-01 #23881
Description
Overview
Score: 74/100 (↑1 from 73). 179 workflows total. Run §23847695461
Summary
| Category | Count |
|---|---|
| Total workflows | 179 |
| Healthy (≥80) | 174 |
| P1 — Active failures | 2 |
| P2 — Team decision | 2 |
| Stale lock files | 22 |
| Recovered this run | 1 (PR Triage Agent) |
P1 — Critical Issues 🚨
Smoke Update Cross-Repo PR (#23193 — open)
- Schedule runs [Custom Engine Test] Test Pull Request - Custom Engine Safe Output #418–[Custom Engine Test] Test Pull Request - Custom Engine Safe Output #477: ALL failing (10+ days consecutive)
- Latest failure: run [Custom Engine Test] Test Pull Request - Custom Engine Safe Output #477 at 2026-04-01T01:07Z
- Root cause:
push_repo_memorygit checkout removesactions/setupfrom working tree - Action: Status update comment added to [aw] Smoke Update Cross-Repo PR failed #23193
Smoke Create Cross-Repo PR (#23715 — open)
- Schedule runs [Custom Engine Test] Test Pull Request - Custom Engine Safe Output #438–[Custom Engine Test] Test Pull Request - Custom Engine Safe Output #477: ALL failing
- Latest failure: run [Custom Engine Test] Test Pull Request - Custom Engine Safe Output #477 at 2026-04-01T01:08Z
- Same root cause as Smoke Update Cross-Repo PR
- Action: Status update comment added to [aw] Smoke Create Cross-Repo PR failed #23715
P2 — External Issues (Team closed as not_planned) ⚠️
Smoke Codex (#23431 — closed not_planned)
- OpenAI API model access restriction. Monitoring only.
Smoke Gemini (#23399 — closed not_planned)
- Exit code 41 failure pattern. Monitoring only.
Watch ⚠️
Smoke Claude (#23528, #23067 — open)
- PR-triggered runs [log] Add debug logging to 5 workflow and CLI files #2606–Add explicit permissions to 7 workflows #2607 failed today (2026-04-01T03:31Z, 04:13Z)
- Schedule run [q] Add explicit permissions to 7 workflows #2605 succeeded (2026-04-01T01:01Z)
- Root cause: MCP HTTP connection timeout at ~412s; agent runs 12min+, MCP closes before safe_outputs
- Cost: ~$1.14–$1.61 per failed run; ~$15–22/week wasted
- APM flagged as ongoing. No new action this run.
✅ Recoveries
PR Triage Agent (#23151 — open, recovered)
- Runs Expand "defaults" in network permission lists #308–support for custom engine to enable testing without llms #313: 9 consecutive successes (2026-03-31 → 2026-04-01)
- Fully recovered from auth failure
⚠️ Please close issue [aw] PR Triage Agent failed #23151 manually — WHM cannot callupdate_issuein schedule context
Stale Lock Files (22 workflows)
View workflows with stale lock files
These workflows have been updated but not recompiled:
- bot-detection, commit-changes-analyzer, copilot-pr-merged-report
- daily-cli-performance, daily-compiler-quality, daily-file-diet
- daily-malicious-code-scan, daily-observability-report, daily-security-red-team
- dependabot-go-checker, discussion-task-miner, github-mcp-tools-report
- go-pattern-detector, jsweep, mergefest, refiner
- repository-quality-improver, scout, smoke-agent-all-none
- smoke-multi-pr, weekly-issue-summary, workflow-skill-extractor
Action needed: Run make recompile or trigger a compilation pass.
Trends
- Overall health: 73→74 (+1)
- PR Triage Agent fully recovered (9 consecutive successes)
- Cross-repo PR smoke tests still blocked on
push_repo_memorybug (2+ weeks) - 22 stale lock files added since last compilation pass
References:
- §23847695461 — This run
- #23193 — Smoke Update Cross-Repo PR (P1, ongoing)
- #23715 — Smoke Create Cross-Repo PR (P1, ongoing)
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
- #21188
search_issues: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | noneGenerated by Workflow Health Manager - Meta-Orchestrator · ◷
- expires on Apr 2, 2026, 12:12 PM UTC