Skip to content

docs: enhance existing pages with audit cross-references and glossary entries#24453

Merged
pelikhan merged 3 commits intomainfrom
copilot/add-audit-glossary-entries
Apr 4, 2026
Merged

docs: enhance existing pages with audit cross-references and glossary entries#24453
pelikhan merged 3 commits intomainfrom
copilot/add-audit-glossary-entries

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 4, 2026

Several documentation pages lacked cross-references to the audit feature, reducing discoverability for users arriving via related topics (network, MCP, cost, monitoring, debugging).

Glossary (reference/glossary.md)

  • Added Audit (gh aw audit) — single-run analysis command
  • Added Behavior Fingerprint — multi-dimensional run characterization (network, tools, tokens, assessments)
  • Added Firewall Analysis — per-run breakdown of allowed/blocked domains with policy attribution
  • Updated Audit Diff and Cross-Run Audit Report — link to /reference/audit/ instead of the generic CLI reference; expanded descriptions to cover MCP and metrics dimensions

Monitoring (patterns/monitoring.md)

  • Replaced the 3-bullet operational monitoring list with a proper section: audit commands, code examples, and a tip on automating trend monitoring with gh aw logs --format markdown

Network (reference/network.md)

  • Added gh aw audit and gh aw audit diff to the Troubleshooting section for inspecting and comparing firewall behavior per run
  • Added [Audit Commands] to Related Documentation

MCP Gateway (reference/mcp-gateway.md)

  • Added a tip block after §8.2 (Health Check Behavior) pointing to gh aw audit for runtime MCP server health inspection and audit diff for regression detection
  • Added [gh-aw-audit] to Informative References

Debugging (troubleshooting/debugging.md)

  • Expanded the audit section: behavior fingerprint, per-server MCP health, and token/cost metrics now appear in the output description
  • Cross-run examples use gh aw logs --format for trend analysis

Cost Management (reference/cost-management.md)

  • Added a paragraph in the Monitoring Costs section directing users to gh aw audit for single-run cost deep-dives and gh aw logs --format markdown for cross-run trends

Copilot AI changed the title [WIP] Enhance existing pages with audit cross-references and glossary entries docs: enhance existing pages with audit cross-references and glossary entries Apr 4, 2026
Copilot AI requested a review from pelikhan April 4, 2026 07:02
Copy link
Copy Markdown
Collaborator

@pelikhan pelikhan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot gh aw audit report is removed. Use gh aw logs instead

Copy link
Copy Markdown
Contributor Author

Copilot AI commented Apr 4, 2026

@copilot gh aw audit report is removed. Use gh aw logs instead

Fixed in 4c0a871 — replaced gh aw audit report with gh aw logs --format markdown in the monitoring.md tip.

Copilot AI requested a review from pelikhan April 4, 2026 07:10
@pelikhan pelikhan marked this pull request as ready for review April 4, 2026 07:10
Copilot AI review requested due to automatic review settings April 4, 2026 07:10
@pelikhan pelikhan merged commit 88d063e into main Apr 4, 2026
3 checks passed
@pelikhan pelikhan deleted the copilot/add-audit-glossary-entries branch April 4, 2026 07:11
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Enhances documentation discoverability for the gh aw audit feature by adding cross-references, expanding troubleshooting/monitoring guidance, and introducing related glossary entries.

Changes:

  • Added/expanded audit-related guidance in debugging, network troubleshooting, MCP gateway references, monitoring patterns, and cost management.
  • Introduced new glossary entries (Audit, Behavior Fingerprint, Firewall Analysis) and updated existing audit-related glossary definitions/links.
  • Replaced/updated multi-run “trend” guidance to emphasize gh aw logs --format markdown.
Show a summary per file
File Description
docs/src/content/docs/troubleshooting/debugging.md Expands gh aw audit output description and updates cross-run guidance to gh aw logs --format.
docs/src/content/docs/reference/network.md Adds troubleshooting guidance for using gh aw audit / gh aw audit diff for firewall behavior.
docs/src/content/docs/reference/mcp-gateway.md Adds an audit tip for MCP health inspection and adds an informative reference link to audit docs.
docs/src/content/docs/reference/glossary.md Adds new audit-related glossary entries and updates audit-related links/descriptions.
docs/src/content/docs/reference/cost-management.md Adds a cost-focused pointer to gh aw audit for single-run deep dives and gh aw logs --format for trends.
docs/src/content/docs/patterns/monitoring.md Reworks operational monitoring into an audit-centric section with commands, examples, and automation tip.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 6/6 changed files
  • Comments generated: 2

### Cross-Run Audit Report (`gh aw logs --format`)

A feature of `gh aw logs` that aggregates firewall data across multiple workflow runs to produce a cross-run security report. The report includes an executive summary, domain inventory, and per-run breakdown. Designed for security reviews, compliance checks, and feeding debugging or optimization agents. Outputs markdown by default (suitable for `$GITHUB_STEP_SUMMARY`), or pretty/JSON format. See [CLI Reference](/gh-aw/setup/cli/#logs).
A feature of `gh aw logs` that aggregates firewall, MCP, and metrics data across multiple workflow runs to produce a security and performance report. Includes an executive summary, domain inventory, and per-run breakdown with anomaly detection. Designed for security reviews, compliance checks, and feeding optimization agents. See [Audit Commands](/gh-aw/reference/audit/#gh-aw-logs-format-fmt).
Copy link

Copilot AI Apr 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The glossary link to the gh aw logs --format <fmt> section likely uses the wrong autogenerated heading anchor. In reference/audit.md the heading text includes --format, which typically slugifies to an anchor with extra hyphens (e.g., gh-aw-logs---format-fmt), so /gh-aw/reference/audit/#gh-aw-logs-format-fmt may 404. Consider either linking to /gh-aw/reference/audit/ without an anchor or updating the anchor to match the generated slug (or adding an explicit heading ID in reference/audit.md and linking to that).

Suggested change
A feature of `gh aw logs` that aggregates firewall, MCP, and metrics data across multiple workflow runs to produce a security and performance report. Includes an executive summary, domain inventory, and per-run breakdown with anomaly detection. Designed for security reviews, compliance checks, and feeding optimization agents. See [Audit Commands](/gh-aw/reference/audit/#gh-aw-logs-format-fmt).
A feature of `gh aw logs` that aggregates firewall, MCP, and metrics data across multiple workflow runs to produce a security and performance report. Includes an executive summary, domain inventory, and per-run breakdown with anomaly detection. Designed for security reviews, compliance checks, and feeding optimization agents. See [Audit Commands](/gh-aw/reference/audit/).

Copilot uses AI. Check for mistakes.
5. Update readiness based on critical server status

> [!TIP]
> To inspect MCP server health for a specific workflow run at runtime, use `gh aw audit <run-id>`. The **MCP Server Health** section of the audit report shows connection failures, timeout errors, tool call counts, and error rates per server — providing a post-run view of gateway behavior. For recurring MCP failures, `gh aw audit diff` compares MCP tool usage between two runs to identify regressions. See [Audit Commands](/gh-aw/reference/audit/).
Copy link

Copilot AI Apr 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This TIP says you can inspect MCP server health "at runtime" via gh aw audit <run-id>, but gh aw audit is a post-run analysis command (it downloads artifacts/logs from a completed run). Rewording to avoid implying live/runtime introspection would prevent confusion (e.g., "for a specific workflow run" / "after the run completes").

Suggested change
> To inspect MCP server health for a specific workflow run at runtime, use `gh aw audit <run-id>`. The **MCP Server Health** section of the audit report shows connection failures, timeout errors, tool call counts, and error rates per server — providing a post-run view of gateway behavior. For recurring MCP failures, `gh aw audit diff` compares MCP tool usage between two runs to identify regressions. See [Audit Commands](/gh-aw/reference/audit/).
> To inspect MCP server health for a specific workflow run after the run completes, use `gh aw audit <run-id>`. The **MCP Server Health** section of the audit report shows connection failures, timeout errors, tool call counts, and error rates per server — providing a post-run view of gateway behavior. For recurring MCP failures, `gh aw audit diff` compares MCP tool usage between two runs to identify regressions. See [Audit Commands](/gh-aw/reference/audit/).

Copilot uses AI. Check for mistakes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

docs: enhance existing pages with audit cross-references and glossary entries

3 participants