Skip to content

✨ feat(hetero): add --raw-dump to persist agent raw stream-json for debugging#15602

Merged
arvinxx merged 2 commits into
canaryfrom
feat/hetero-raw-stream-dump
Jun 9, 2026
Merged

✨ feat(hetero): add --raw-dump to persist agent raw stream-json for debugging#15602
arvinxx merged 2 commits into
canaryfrom
feat/hetero-raw-stream-dump

Conversation

@arvinxx

@arvinxx arvinxx commented Jun 9, 2026

Copy link
Copy Markdown
Member

πŸ’» Change Type

  • ✨ feat

πŸ”— Related Issue

Part of LOBE-10157. Debugging tooling follow-up to #15585 (which fixed the cross-message text duplication). This lands the raw-stream capture needed to root-cause the remaining bugs (notably the empty tool_result).

πŸ”€ Description of Change

The remote-device path (spawnLhHeteroExec) leaves no local execution record: lh hetero exec consumes the agent process's stdout internally and only POSTs adapted events to the server, so a misbehaving remote run can't be inspected. The adapted/ingested view also can't distinguish a CC-side empty tool_result from an adapter extraction bug.

Adds lh hetero exec --raw-dump <dir>:

  • spawnAgent gains an onRawStdout tee that captures the child's untouched stdout before the adapter. Best-effort: a throwing sink can't break the stream.
  • CLI: --raw-dump <dir> writes the raw stream to <dir>/<timestamp>-<operationId>/, with <attempt>.stdout.jsonl / <attempt>.stderr.log (the resume retry is a second attempt) plus a meta.json. Independent of --render and the server-ingest path; a dump failure never affects the run or exit code.
  • Desktop device path (spawnLhHeteroExec): passes --raw-dump gated by the existing shouldTraceCliOutput toggle, into resolveTraceRootDir β€” so remote-device CC runs now leave a raw stream on the device, in the same location/toggle the local trace path already uses.
  • Reusable later for the server sandbox runner (spawnHeteroSandbox) to capture remote-server runs the same way.

πŸ§ͺ How to Test

  • Added/updated tests

  • spawnAgent.test.ts: onRawStdout receives the raw bytes verbatim (pre-adapter); a throwing sink doesn't disrupt the stream.

  • hetero.test.ts: --raw-dump creates the session folder + meta.json, wires onRawStdout into spawnAgent, and tees stderr.

  • Verified end-to-end against the real claude CLI: the dump contains the untouched CC stream-json (raw tool_result content, message.id, raw blocks).

πŸ“ Additional Information

The capture is the missing piece for diagnosing LOBE-10157 Bug 2 (empty tool_result), which was shown not to be an adapter extraction bug and needs the actual failing run's raw stream to root-cause.

@sourcery-ai sourcery-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry @arvinxx, you have reached your weekly rate limit of 500000 diff characters.

Please try again later or upgrade to continue using Sourcery

@vercel

vercel Bot commented Jun 9, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
lobehub Canceled Canceled Jun 9, 2026 2:35pm

Request Review

@dosubot dosubot Bot added size:L This PR changes 100-499 lines, ignoring generated files. feature:agent Assistant/Agent configuration and behavior platform:desktop Desktop client labels Jun 9, 2026
@arvinxx arvinxx force-pushed the feat/hetero-raw-stream-dump branch from 275f5ff to 19c2dee Compare June 9, 2026 12:43
@codecov

codecov Bot commented Jun 9, 2026

Copy link
Copy Markdown

Codecov Report

βœ… All modified and coverable lines are covered by tests.
βœ… Project coverage is 67.13%. Comparing base (5b534f4) to head (19c2dee).

Additional details and impacted files
@@            Coverage Diff             @@
##           canary   #15602      +/-   ##
==========================================
+ Coverage   65.82%   67.13%   +1.31%     
==========================================
  Files        3270     3353      +83     
  Lines      320011   338490   +18479     
  Branches    27141    35046    +7905     
==========================================
+ Hits       210651   227258   +16607     
- Misses     109169   111041    +1872     
  Partials      191      191              
Flag Coverage Ξ”
app 60.14% <ΓΈ> (ΓΈ)
database 89.90% <ΓΈ> (?)
packages/agent-manager-runtime 49.69% <ΓΈ> (ΓΈ)
packages/agent-runtime 81.06% <ΓΈ> (ΓΈ)
packages/app-config 44.58% <ΓΈ> (ΓΈ)
packages/builtin-tool-lobe-agent 18.52% <ΓΈ> (ΓΈ)
packages/context-engine 84.12% <ΓΈ> (ΓΈ)
packages/conversation-flow 91.29% <ΓΈ> (ΓΈ)
packages/device-gateway-client 90.18% <ΓΈ> (ΓΈ)
packages/env 11.42% <ΓΈ> (ΓΈ)
packages/eval-dataset-parser 95.15% <ΓΈ> (ΓΈ)
packages/eval-rubric 76.11% <ΓΈ> (ΓΈ)
packages/fetch-sse 85.57% <ΓΈ> (-1.72%) ⬇️
packages/file-loaders 87.89% <ΓΈ> (ΓΈ)
packages/locales 0.87% <ΓΈ> (ΓΈ)
packages/memory-user-memory 74.99% <ΓΈ> (ΓΈ)
packages/model-bank 99.99% <ΓΈ> (ΓΈ)
packages/model-runtime 84.23% <ΓΈ> (ΓΈ)
packages/prompts 72.51% <ΓΈ> (ΓΈ)
packages/python-interpreter 92.90% <ΓΈ> (ΓΈ)
packages/ssrf-safe-fetch 0.00% <ΓΈ> (ΓΈ)
packages/trpc 40.43% <ΓΈ> (ΓΈ)
packages/types 35.21% <ΓΈ> (ΓΈ)
packages/utils 85.06% <ΓΈ> (ΓΈ)
packages/web-crawler 88.08% <ΓΈ> (ΓΈ)

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Ξ”
Store 68.24% <ΓΈ> (ΓΈ)
Services 54.25% <ΓΈ> (ΓΈ)
Server 97.03% <ΓΈ> (ΓΈ)
Libs 54.03% <ΓΈ> (ΓΈ)
Utils 82.08% <ΓΈ> (ΓΈ)
πŸš€ New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • πŸ“¦ JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

arvinxx and others added 2 commits June 9, 2026 22:13
…ebugging

The remote-device path (`spawnLhHeteroExec`) leaves no local execution
record: `lh hetero exec` consumes the agent's stdout internally and only
POSTs adapted events to the server, so a misbehaving remote run can't be
inspected. The adapted/ingested view also can't distinguish a CC-side
empty `tool_result` from an adapter extraction bug.

Add `lh hetero exec --raw-dump <dir>`: spawnAgent gains an `onRawStdout`
tee that captures the child's untouched stdout BEFORE the adapter; the
CLI writes it (plus stderr + a meta.json) to
`<dir>/<timestamp>-<operationId>/`, one file pair per spawn attempt.
Fully best-effort β€” a dump failure never affects the run or exit code.

Wire the desktop device path to pass `--raw-dump` (gated by the existing
`shouldTraceCliOutput` toggle, into `resolveTraceRootDir`), so remote-device
CC runs now leave a raw stream on the device β€” the same toggle/location the
local trace path already uses. Reusable later for the server sandbox path.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@arvinxx arvinxx force-pushed the feat/hetero-raw-stream-dump branch from 19c2dee to 7feb6bb Compare June 9, 2026 14:15
@arvinxx arvinxx merged commit e01cadb into canary Jun 9, 2026
23 of 24 checks passed
@arvinxx arvinxx deleted the feat/hetero-raw-stream-dump branch June 9, 2026 14:16
arvinxx added a commit that referenced this pull request Jun 10, 2026
# πŸš€ LobeHub Release (20260610)

**Release Date:** June 10, 2026  
**Since v2.2.2:** 131 merged PRs Β· 13 contributors

> This weekly release strengthens agent collaboration across cloud,
desktop, CLI, and workspace flows, with steadier runtime behavior and a
broader foundation for workspace-scoped data.

---

## ✨ Highlights

- **Agent execution across devices** β€” Unifies per-device working
directories, project skill discovery, and sub-agent suspend/resume
behavior across server, QStash, and device RPC flows. (#15543, #15566,
#15481, #15620, #15591)
- **Connector and sandbox platform** β€” Expands connector permissions,
custom OAuth MCP connector onboarding, sandbox provider support, and
user-uploaded file sync into cloud sandbox runs. (#15463, #15546,
#15184, #15550)
- **Desktop and CLI reliability** β€” Fixes desktop cold-start,
auto-update, Windows build, CLI skill discovery, and `lh connect` agent
dispatch paths. (#15547, #15525, #15527, #15562, #15632, #15634)
- **Pages and sharing** β€” Refreshes topic sharing, improves Page Editor
layout behavior, and routes Page Agent tool execution through the
server-side editor path. (#15581, #15556, #15588, #15023, #15610)
- **Model availability and provider updates** β€” Adds user-scoped LobeHub
model availability, Claude Fable 5, Qwen thinking preservation, and
MiniMax M3 updates. (#15590, #15639, #13494, #15376)

---

## πŸ—οΈ Core Product & Architecture

### Agent Runtime & Heterogeneous Agents

- Improves sub-agent lifecycle handling, including async suspend/resume,
queue-mode QStash resume delivery, and blocking nested sub-agent calls.
(#15481, #15620, #15575)
- Stabilizes heterogeneous agent ingestion and streaming with raw stream
dumps, per-turn usage, image forwarding on regenerate, and
duplicate-text fixes. (#15602, #15577, #15592, #15585)
- Adds execution-device and working-directory controls across device
RPC, legacy defaults, and remote-spawned Claude Code sessions. (#15543,
#15566, #15591, #15572)
- Improves runtime diagnostics and compatibility, including Gemini
multimodal output capture, abort stream semantics, and trace quality
analysis. (#15535, #13677, #15508)

---

## πŸ“± Platforms, Integrations & UX

### Connectors, Sandbox & Tools

- Ships API-level connector tool permissions, custom OAuth MCP connector
onboarding, and connector-first runtime execution. (#15463, #15546)
- Adds sandbox provider support, cloud sandbox file sync, and safer
external URL file input handling with SSRF validation. (#15184, #15550,
#12657)
- Improves tool visibility and execution with pinned app-fixed tools,
ANSI output rendering, gateway-tunneled MCP calls, and automatic
headless tool runs. (#15509, #15516, #15469, #15492)

### Desktop, CLI & Web UX

- Restores desktop startup and reload behavior, preserves IPC error
causes, and keeps the tab bar new-tab action visible across routes.
(#15547, #15597, #15638)
- Fixes desktop update and build stability for browser quit guards,
macOS update signing, and Windows Visual Studio detection. (#15525,
#15527, #15562)
- Shows the plan-limit upgrade UI on desktop builds. (#15628)
- Adds the Agent Run delivery checker and fixes CLI device dispatch plus
skill list/search output. (#15489, #15634, #15632)
- Refreshes onboarding, auth source preservation, topic UI states,
referral/Fable campaign copy, and chat-input control bar behavior.
(#15629, #15544, #15573, #15614, #15616, #15617, #15622, #15643)

---

## πŸ”’ Security, Reliability & Rollout Notes

- External URL file input now includes SSRF validation for safer Google
file handling. (#12657)
- Database workspace-scope migrations are part of this release;
self-hosted operators should run the normal migration path before
serving the updated app. (#15446, #15465, #15468, #15472)
- The release branch was re-cut from `canary` and includes the latest
`main` release-version commit so `v2.2.2` is the verified compare base.

---

## πŸ‘₯ Contributors

@ONLY-yours, @sxjeru, @hardy-one, @xujingli, @hezhijie0327, @Coooolfan,
@arvinxx, @tjx666, @Innei, @rivertwilight, @rdmclin2, @cy948,
@AmAzing129

**Full Changelog**:
v2.2.2...release/weekly-20260610-recut-3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature:agent Assistant/Agent configuration and behavior platform:desktop Desktop client size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant