feat(honcho): optional lightweight cached startup context for recallMode=tools#2164
Open
teyrebaz33 wants to merge 1 commit into
Open
feat(honcho): optional lightweight cached startup context for recallMode=tools#2164teyrebaz33 wants to merge 1 commit into
teyrebaz33 wants to merge 1 commit into
Conversation
|
Whoops didn't catch that ! I implemented my version, have you had any success testing yours ? |
19 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #2150
What
Adds an opt-in background prewarm for
recallMode=toolsthat fetches a small user snapshot (representation + peer card) from Honcho on/newor session reset, and injects it into the first real turn's user message.How
HonchoClientConfig: newtools_startup_context: bool = Falsefield (JSON key:toolsStartupContext)HonchoSessionManager.fetch_startup_snapshot(peer_id): fetches user representation + peer card without requiring an active session in local cacherun_agent.py:_schedule_honcho_startup_prewarm()fires a daemon thread on session init;_pop_startup_snapshot()consumes it once on first turncli.py: prewarm triggered innew_session()gateway/run.py: prewarm triggered after reset,_honcho_startup_cachekeyed bypeer_nameDesign decisions
_honcho_turn_context(user message append), not_honcho_context(system prompt) — prompt cache prefix stays stablepop()semantics — consumed exactly once, subsequent turns unaffectednot conversation_historyguard — first turn onlypeer_name(stable Honcho identity), not ephemeral session IDNot included (by design)
Continuity-style recall is intentionally excluded per issue spec —
/newsemantically means a fresh session.