Skip to content

docs: fast-follow to improve Brev web UI guide and update doc-only PR contribution instruction#3050

Merged
miyoungc merged 5 commits into
mainfrom
docs/improve-brev-docs
May 5, 2026
Merged

docs: fast-follow to improve Brev web UI guide and update doc-only PR contribution instruction#3050
miyoungc merged 5 commits into
mainfrom
docs/improve-brev-docs

Conversation

@miyoungc

@miyoungc miyoungc commented May 5, 2026

Copy link
Copy Markdown
Collaborator

Summary

Improves the Brev Web UI guide so it matches the current UI flow for deploying the instance, opening the setup page, configuring providers, and handling gateway pairing. Also clarifies that doc-only PRs should use docs and hook verification instead of requiring the full test suite by default.

Related Issue

None.

Changes

  • Moves the Brev Web UI guide under docs/deployment/ and updates the docs toctree entry.
  • Rewrites the guide around the direct Brev launchable link, right-side deployment panel, Configure/Setup/Launch stages, provider dropdown, and post-launch pairing behavior.
  • Suppresses repeated sphinx-reredirects info logs during incremental docs builds while keeping redirect warnings visible.
  • Updates contributor PR guidance, the docs contributing guide, and the PR template to clarify doc-only verification expectations.

Type of Change

  • Code change (feature, bug fix, or refactor)
  • Code change with doc updates
  • Doc only (prose changes, no code sample modifications)
  • Doc only (includes code sample changes)

Verification

  • npx prek run --all-files passes
  • npm test passes
  • Tests added or updated for new or changed behavior
  • No secrets, API keys, or credentials committed
  • Docs updated for user-facing behavior changes
  • make docs builds without warnings (doc changes only)
  • Doc pages follow the style guide (doc changes only)
  • New doc pages include SPDX header and frontmatter (new pages only)

Signed-off-by: Miyoung Choi miyoungc@nvidia.com

Summary by CodeRabbit

  • Documentation
    • Added a Brev Web UI deployment guide, removed the older Brev quickstart, updated docs navigation, expanded contributor guidance with a doc-only PR verification flow, and adjusted PR template structure and contributor-facing instructions distinguishing doc-only vs code changes.
  • Chores
    • Reduced Sphinx/doc build log verbosity during incremental builds.

Co-authored-by: Cursor <cursoragent@cursor.com>
@coderabbitai

coderabbitai Bot commented May 5, 2026

Copy link
Copy Markdown
Contributor

Note

Reviews paused

It looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the reviews.auto_review.auto_pause_after_reviewed_commits setting.

Use the following commands to manage reviews:

  • @coderabbitai resume to resume automatic reviews.
  • @coderabbitai review to trigger a single review.

Use the checkboxes below for quick actions:

  • ▶️ Resume reviews
  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

The PR moves a Brev Web UI quickstart into a new deployment guide, updates the docs index to the new path, deletes the old quickstart file, adds doc-only PR verification guidance across contributor docs and a skill, updates the PR template placeholder, and configures Sphinx to suppress info logs from the redirect plugin.

Changes

Documentation Reorganization & Verification Guidance

Layer / File(s) Summary
Content Creation
docs/deployment/brev-web-ui.md
Added a published Brev Web UI deployment guide with prerequisites, nvapi key instructions, deployment/setup/launch steps, dashboard pairing notes, first-chat startup, USER.md personalization, stopping the instance, and "Next Steps" links.
Navigation Update
docs/index.md
Updated Deployment toctree entry to reference deployment/brev-web-ui instead of the removed quickstart path.
Legacy Content Removal
docs/get-started/brev-web-ui-quickstart.md
Removed the original Brev Web UI quickstart now superseded by the deployment guide.
Contributor Guidance
CONTRIBUTING.md, docs/CONTRIBUTING.md, .agents/skills/nemoclaw-contributor-create-pr/SKILL.md
Added Doc-Only PR Verification guidance: run npx prek run --all-files + make docs for documentation-only PRs and leave npm test unchecked unless runtime/code changes are included; updated skill and contributing docs accordingly.
PR Template Update
.github/PULL_REQUEST_TEMPLATE.md
Replaced the prior verification checklist placeholder with a new "new hunk" marker line in the PR template.
Sphinx Logging
docs/conf.py
Imported Python logging and set the sphinx.sphinx_reredirects logger level to logging.WARNING to suppress info-level messages during incremental builds.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~10 minutes

Poem

🐇 I hopped through pages, tidy and spry,
Moved a quickstart where deployments lie.
Quieted redirects with a gentle plea,
Docs now breathe softly — quiet as can be. ✨

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly summarizes the main changes: relocating and improving the Brev web UI documentation guide and updating contributor guidelines for doc-only PRs.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch docs/improve-brev-docs

Comment @coderabbitai help to get the list of available commands and usage tips.

Co-authored-by: Cursor <cursoragent@cursor.com>
@miyoungc miyoungc changed the title docs: improve Brev web UI guide docs: improve Brev web UI guide and update doc-only PR contribution instruction May 5, 2026
@miyoungc miyoungc changed the title docs: improve Brev web UI guide and update doc-only PR contribution instruction docs: fast-follow to improve Brev web UI guide and update doc-only PR contribution instruction May 5, 2026

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🧹 Nitpick comments (1)
docs/deployment/brev-web-ui.md (1)

29-30: 💤 Low value

Rephrase to avoid repetition.

The phrase "want to" appears in consecutive sentences.
Consider replacing the second instance to add variety.

Example revision:

 Use this guide when you want to try NemoClaw without installing the CLI or using a local GPU.
-If you want to manage the remote host from a terminal, see [Deploy to a Remote GPU Instance](deploy-to-remote-gpu.md).
+To manage the remote host from a terminal, see [Deploy to a Remote GPU Instance](deploy-to-remote-gpu.md).
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/deployment/brev-web-ui.md` around lines 29 - 30, The two sentences
repeat the phrase "want to"; update the second sentence that begins "If you want
to manage the remote host from a terminal..." to avoid repetition — e.g., reword
it to "To manage the remote host from a terminal, see [Deploy to a Remote GPU
Instance](deploy-to-remote-gpu.md)." — keep the first sentence ("Use this guide
when you want to try NemoClaw without installing the CLI or using a local GPU.")
unchanged and ensure the replacement removes the duplicate "want to".
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/deployment/brev-web-ui.md`:
- Around line 116-121: Replace the four-colon MyST admonition delimiter
`::::{note}`/`::::` with the correct three-colon form `:::{note}`/`:::` and
split the line that currently contains two sentences ("Wait for about a few
minutes for pairing to finish automatically. Refresh the dashboard to see if the
warning is resolved and the connection is established.") into two separate lines
so each sentence is on its own line; also change "about a few minutes" to "a few
minutes" for clarity.

---

Nitpick comments:
In `@docs/deployment/brev-web-ui.md`:
- Around line 29-30: The two sentences repeat the phrase "want to"; update the
second sentence that begins "If you want to manage the remote host from a
terminal..." to avoid repetition — e.g., reword it to "To manage the remote host
from a terminal, see [Deploy to a Remote GPU
Instance](deploy-to-remote-gpu.md)." — keep the first sentence ("Use this guide
when you want to try NemoClaw without installing the CLI or using a local GPU.")
unchanged and ensure the replacement removes the duplicate "want to".
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: df944f5a-7169-4764-bb33-e408adb41bfe

📥 Commits

Reviewing files that changed from the base of the PR and between 693de6c and 531ec06.

📒 Files selected for processing (4)
  • docs/conf.py
  • docs/deployment/brev-web-ui.md
  • docs/get-started/brev-web-ui-quickstart.md
  • docs/index.md
💤 Files with no reviewable changes (1)
  • docs/get-started/brev-web-ui-quickstart.md

Comment thread docs/deployment/brev-web-ui.md

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/CONTRIBUTING.md`:
- Around line 114-117: Update the CLI example block in CONTRIBUTING.md to use
the console code fence and add shell prompt prefixes: replace the existing
```bash block with ```console and prefix each command line with "$ " (e.g., "$
npx prek run --all-files" and "$ make docs") so the example follows the required
`console` language tag and prompt convention.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: faa3f8c9-0acc-4cb9-a0e7-12d4826e8908

📥 Commits

Reviewing files that changed from the base of the PR and between 531ec06 and 84708b8.

📒 Files selected for processing (4)
  • .agents/skills/nemoclaw-contributor-create-pr/SKILL.md
  • .github/PULL_REQUEST_TEMPLATE.md
  • CONTRIBUTING.md
  • docs/CONTRIBUTING.md
✅ Files skipped from review due to trivial changes (2)
  • .github/PULL_REQUEST_TEMPLATE.md
  • CONTRIBUTING.md

Comment thread docs/CONTRIBUTING.md
Co-authored-by: Cursor <cursoragent@cursor.com>

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
docs/deployment/brev-web-ui.md (1)

43-45: ⚡ Quick win

Add a one-sentence intro before section lists.

Both ## Prerequisites and ## Launch NemoClaw from Brev start directly with list items. Add one introductory sentence under each heading before the list.

As per coding guidelines, "Sections use H2 and H3, each starting with an introductory sentence."

Also applies to: 63-66

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/deployment/brev-web-ui.md` around lines 43 - 45, The headings "##
Prerequisites" and "## Launch NemoClaw from Brev" (and the section around lines
63-66) begin immediately with lists; add a single introductory sentence under
each H2 that briefly describes the purpose of the section before the list items
so the section follows the guideline "Sections use H2 and H3, each starting with
an introductory sentence." Locate the headings "## Prerequisites" and "## Launch
NemoClaw from Brev" and insert one clear, concise sentence under each (e.g.,
what the reader will need or what the section will show) before the existing
bullet lists.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@docs/deployment/brev-web-ui.md`:
- Around line 43-45: The headings "## Prerequisites" and "## Launch NemoClaw
from Brev" (and the section around lines 63-66) begin immediately with lists;
add a single introductory sentence under each H2 that briefly describes the
purpose of the section before the list items so the section follows the
guideline "Sections use H2 and H3, each starting with an introductory sentence."
Locate the headings "## Prerequisites" and "## Launch NemoClaw from Brev" and
insert one clear, concise sentence under each (e.g., what the reader will need
or what the section will show) before the existing bullet lists.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 50b5f64b-6f02-4902-8256-d40657af0a18

📥 Commits

Reviewing files that changed from the base of the PR and between 84708b8 and 92ece91.

📒 Files selected for processing (1)
  • docs/deployment/brev-web-ui.md

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🧹 Nitpick comments (1)
docs/deployment/brev-web-ui.md (1)

52-52: ⚡ Quick win

Split Line 52 into one sentence per line.

Line 52 currently contains two sentences on a single source line; split them into separate lines to match docs formatting rules.

As per coding guidelines, “One sentence per line in source (makes diffs readable).”

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@docs/deployment/brev-web-ui.md` at line 52, Split the source line that
currently reads "If you already have an NVIDIA API key skip this section.
Otherwise, follow these steps to generate a new key:" into two separate lines so
each sentence is on its own source line; locate the exact string "If you already
have an NVIDIA API key skip this section. Otherwise, follow these steps to
generate a new key:" and replace it with two lines: one containing "If you
already have an NVIDIA API key skip this section." and the next containing
"Otherwise, follow these steps to generate a new key:" ensuring trailing
punctuation and whitespace are preserved.
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Nitpick comments:
In `@docs/deployment/brev-web-ui.md`:
- Line 52: Split the source line that currently reads "If you already have an
NVIDIA API key skip this section. Otherwise, follow these steps to generate a
new key:" into two separate lines so each sentence is on its own source line;
locate the exact string "If you already have an NVIDIA API key skip this
section. Otherwise, follow these steps to generate a new key:" and replace it
with two lines: one containing "If you already have an NVIDIA API key skip this
section." and the next containing "Otherwise, follow these steps to generate a
new key:" ensuring trailing punctuation and whitespace are preserved.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 73b89393-88ea-4d97-9b7d-f6ea1f9acab1

📥 Commits

Reviewing files that changed from the base of the PR and between 92ece91 and 757d83f.

📒 Files selected for processing (1)
  • docs/deployment/brev-web-ui.md

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@docs/deployment/brev-web-ui.md`:
- Around line 18-21: The SPDX header is currently inside a single multi-line
HTML comment; replace it with two separate single-line HTML comments so each
SPDX tag is on its own line: one comment containing "SPDX-FileCopyrightText:
..." and a second comment containing "SPDX-License-Identifier: ..."; update the
block containing SPDX-FileCopyrightText and SPDX-License-Identifier so they
appear as <!-- SPDX-FileCopyrightText: ... --> and <!-- SPDX-License-Identifier:
... --> respectively at the top of the document.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Enterprise

Run ID: 7bcdff9a-edb7-4a0e-8287-c2ca8ccaf793

📥 Commits

Reviewing files that changed from the base of the PR and between 757d83f and 199cb79.

📒 Files selected for processing (1)
  • docs/deployment/brev-web-ui.md

Comment thread docs/deployment/brev-web-ui.md

@ericksoa ericksoa left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we preserve the old published URL for this moved page before merging?

The PR moves docs/get-started/brev-web-ui-quickstart.md to docs/deployment/brev-web-ui.md, but I do not see a corresponding entry in the redirects map in docs/conf.py. Should this move add a redirect such as:

"get-started/brev-web-ui-quickstart": "../deployment/brev-web-ui.html",

so existing links to /get-started/brev-web-ui-quickstart.html keep working after the page moves?

I checked the built output locally after make docs-strict: the new page is emitted at deployment/brev-web-ui.html, but get-started/brev-web-ui-quickstart.html is not generated.

@miyoungc

miyoungc commented May 5, 2026

Copy link
Copy Markdown
Collaborator Author

@ericksoa This is a fast follow after the initial page just merged (NVIDIA/NemoClaw#2563)) a little before this PR. The new page hasn't been published, so no need for a redirect.

@miyoungc miyoungc requested a review from ericksoa May 5, 2026 20:00

@ericksoa ericksoa left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved after re-review. The earlier redirect concern is resolved by the fast-follow timing: the moved page has not been published yet, and the new deployment path is linked from the docs index. I also verified the doc build locally and reviewed the current PR checks.

@miyoungc miyoungc merged commit 9178236 into main May 5, 2026
22 checks passed
cv added a commit that referenced this pull request May 27, 2026
> **Note:** This PR supersedes #3063, which had unsigned commits in its
history (a stale local git config in one of my clones —
`user.email=test@example.com`, `commit.gpgsign=false` — produced 8
unverified commits I couldn't retroactively sign because the branch
ruleset blocks force-push). Net diff vs `main` is unchanged. All commits
on this branch are signed and authored by `prekshiv@nvidia.com`. The 8
post-review commits from #3063 are collapsed into a single signed
commit; per-commit history for those is preserved in #3063 for
reference.

---

## Summary

Adds maintainer skill `nemoclaw-maintainer-verify-stale` — automates the
manual loop of: spin up a Brev box → install latest NemoClaw → try to
reproduce an old bug → comment with findings. Tag-only (never
auto-closes); a maintainer pulls the trigger after reviewing.

The skill has been driven end-to-end against **9 real candidates**
during development, surfacing the gaps and skill changes summarised
below.

## Issues tackled

| Issue | Reported | Verified | Verdict | Score | What this run surfaced
(skill change) |
|---|---|---|---|---|---|
| [#2791](#2791) | v0.0.21 |
v0.0.35 | `wontfix-by-design` | — | By-design prototype. Step 8.5
detection framework (3 signals: maintainer attribution / removal commit
/ symbol absent). Maintainer reviewed the analysis and **closed the
issue manually**. |
| [#2168](#2168) | v0.0.21 |
v0.0.35 | `wontfix-by-design` (tagged) | — | Repo-label vocabulary
mismatch (`status: wont-fix`, not `wontfix`); markdown-linked citations
in comments. |
| [#2007](#2007) | v0.0.18 |
v0.0.35 | `fixed-on-latest` (tagged) | 84/100 | Docker-group `sg`, `brev
exec` PATH gotcha, sandbox-build-rot reframe, multi-axis
architectural-drift check. |
| [#2592](#2592) | v0.0.28 |
v0.0.35 | `fixed-on-latest` (tagged) | 84/100 | Sentinel-file SSH-drop
guard, `openshell sandbox exec -n NAME --` syntax footgun,
reproducer-extraction regex extension (`openclaw\|openshell`). |
| [#2519](#2519) | v0.0.26 |
v0.0.35 | `fixed-on-latest` (closed by maintainer mid-run) | 84/100 |
Step 5 provider classification + API-key prompt, install.sh env-var
passthrough, sandbox-name validator. |
| [#2604](#2604) | v0.0.28 |
v0.0.36 | `fixed-on-latest` (tagged) | 84/100 | **File-based API key
propagation** (kill argv exposure local→Brev). 300-word hard ceiling for
comments + comment-authoring principle in Step 10. |
| [#2611](#2611) | v0.0.28 |
v0.0.36 | `fixed-on-latest` (tagged) | 70/100 | **On-box subshell argv
leak** (extend file-based pattern to Brev→inner shell). First
non-cap-at-84 score (the −30 LLM-synth penalty pushed raw below the
cap). |
| [#2513](#2513) | v0.0.26 | —
| maintainer self-verified mid-batch | — | Gap-queue: skill should
re-check `state == OPEN` before posting. Second mid-batch
close-by-maintainer (alongside #2519) → promote from queue to a real
Step 1/3 check. |
| [#2166](#2166) | v0.0.21 | —
| still-reproduces (source-only) | — | Gap-queue: when pre-flight is
conclusive, allow source-only verdicts to skip Brev entirely
(`Verification mode: static analysis at <tag>`). |

**Effective touched count: 7 issues with skill-rendered comments + 2
side-discoveries.** Two of the seven landed `wontfix-by-design`, five
landed `fixed-on-latest`. Sandbox-build rot capped four of the five at
84 (the modal verdict shape with reporter @-mention). #2611 was the
first run to land below the cap, validating the −30 LLM-synth penalty
path.

## v1 scope

| | |
|---|---|
| **In** | Linux only (Brev), `bug` issues against CLI / Sandbox /
OpenShell / Docker / Getting Started / Ubuntu / DGX Spark / GB10 |
| **Out** | macOS, Windows/WSL, integration bugs needing third-party
tokens, service-account bots, auto-close |

## Verification flow (one-line per step)

| Step | Purpose |
|---|---|
| 6.5 — Preconditions | Brev auth + install-URL reachability fail-fast
(no Brev cost on dead deps) |
| 6.7 — Local-first | Pure-CLI bugs (no sandbox/Docker/GPU) run on the
maintainer's local install — same evidence, zero cost |
| 7 — Reuse-or-provision | `brev ls` → reuse a `verify-stale-*` box if
running, else `brev create` with a runtime-picked CPU SKU |
| 8 — Validate-on-baseline, verify-on-latest | Install reported version
first, confirm the reproducer actually exposes the bug, reset, then
install latest |
| 8.5 — By-design detection | Three signals (maintainer attribution /
removal commit / symbol absent) short-circuit Brev cost on intentional
removals |
| 9 — Confidence scoring | +50 / +25 / +25 / −30 / −50, clamped to
[0,100]. ≥85 silent · 60–84 + reporter @-mention · <60 inconclusive |
| 10 — Comment + label | Comprehensive redaction (JWT / NVAPI / PAT /
base64 / internal hostnames / emails) with HTML→text pre-pass for QA
bodies. 300-word hard ceiling for fixed/wontfix; 30–80 for
still-reproduces. |
| 11 — Infra failure | Sandbox-build rot is the dominant failure mode
for any version >5–7 patches behind; cap-at-84 with reporter @-mention
is by design |
| 12 — Activity log | Append per-issue + per-session entries to
`~/development/daily-rhythm/activity/nemoclaw-verify-stale-log.md` |

## Idempotency

Every posted comment carries `<!-- nemoclaw-verify-stale v1 YYYY-MM-DD
-->`. Candidate filter excludes any issue whose comments match `<!--
nemoclaw-verify-stale v\d+ YYYY-MM-DD -->` within the last 7 days OR
carries `fixed-on-latest` / `verify-inconclusive` / `status: wont-fix`.
Release sweep clears the first two on each tag cut.

## Active-discussion handling (two-tier)

| Maintainer's unanswered comment age | Skill behaviour |
|---|---|
| ≤ 7 days | Skip — running on top of fresh discussion would conflict
with the maintainer's framing |
| > 7 days | Proceed with the **unanswered-question variant**: lead with
a markdown link to the unanswered comment, dual @-mention of both
maintainer and reporter |

## Companion changes

- **`nemoclaw-skills-guide/SKILL.md`** — adds the new skill to the
maintainer skills table.
- **`nemoclaw-maintainer-cut-release-tag/SKILL.md`** — release-time
sweep of `fixed-on-latest` and `verify-inconclusive` from every open
issue. Without it, "latest" drifts and verifications go silently stale.
Verification records stay in comments; only labels reset.

## CI status

| Check | Status |
|---|---|
| commit-lint, dco-check, installer-hash-check, legacy-path-guard,
pr/changes | ✅ |
| markdown-links | ✅ after
[`3abffd72`](3abffd72)
(placeholder `[label](url)` examples in SKILL.md were being parsed as
real broken links — restructured as fenced-block templates) and
[`dc5d7143`](dc5d7143) (merge
of main brought in the deletion of
`docs/get-started/brev-web-ui-quickstart.md` per #3050, resolving the
merge-side missing-file failure) |

## Test plan

- [x] Step 3 candidate filter dry-run against the open-issue list (24
candidates after filtering 105 raw)
- [x] By-design detection on #2791 — landed `wontfix-by-design`,
maintainer agreed and closed
- [x] By-design detection on #2168 — landed `wontfix-by-design`, tagged
+ open awaiting close
- [x] End-to-end Brev runs ×5 (#2007, #2592, #2519, #2604, #2611) —
provision → baseline → reset → latest → repro → comment + label
- [x] Sandbox-build rot path — 5 of 5 e2e runs hit it; cap-at-84 verdict
shape works as designed
- [x] HTML body redaction — exercised on every NV-QA-filed issue (all
five e2e candidates were NV QA bodies)
- [x] Marker idempotency — no double-posts across the seven runs
- [x] Hardware-substitution caveat — exercised live on #2611 (`Platform:
DGX Spark` label, x86_64 actual)
- [ ] Active-discussion two-tier rule — variant code is in skill
(`f0ec6b8e`) but **untested against a live candidate** (no qualifying
issue in the candidate set yet)
- [ ] Local-first short-circuit (Step 6.7) — designed but not yet
exercised against a pure-CLI candidate
- [ ] Release-tag sweep — companion change in `cut-release-tag` tested
at design level only

Signed-off-by: Prekshi Vyas <prekshiv@nvidia.com>


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

* **New Features**
* New maintainer skill to verify whether stale bug reports reproduce on
the latest release, with interactive reproducer validation and
evidence-backed comments/labels.

* **Enhancements**
* Release-tag workflow now conditionally clears verification labels from
open issues when verification is stale or regression risk is detected
(preserves labels in specified safe cases).

* **Documentation**
* Added comprehensive reference guides covering candidate selection,
environment/reproducer setup, provisioning, reproduction rubrics,
scoring, comments, and logging.

<!-- review_stack_entry_start -->

[![Review Change
Stack](https://storage.googleapis.com/coderabbit_public_assets/review-stack-in-coderabbit-ui.svg)](https://app.coderabbit.ai/change-stack/NVIDIA/NemoClaw/pull/3327?utm_source=github_walkthrough&utm_medium=github&utm_campaign=change_stack)

<!-- review_stack_entry_end -->
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

---------

Signed-off-by: Prekshi Vyas <prekshiv@nvidia.com>
Signed-off-by: Carlos Villela <cvillela@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Test User <test@example.com>
Co-authored-by: Carlos Villela <cvillela@nvidia.com>
@miyoungc miyoungc deleted the docs/improve-brev-docs branch May 27, 2026 20:51
@wscurran wscurran added area: docs Documentation, examples, guides, or docs build chore Build, CI, dependency, or tooling maintenance and removed documentation labels Jun 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area: docs Documentation, examples, guides, or docs build chore Build, CI, dependency, or tooling maintenance

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants