feat(cron): auto-inherit compression provider from per-job settings#7633
Open
kshitijk4poor wants to merge 1 commit into
Open
feat(cron): auto-inherit compression provider from per-job settings#7633kshitijk4poor wants to merge 1 commit into
kshitijk4poor wants to merge 1 commit into
Conversation
…ings (NousResearch#5438) Cron jobs support per-job model/provider overrides for the main chat model, but compression always uses the global config. This means a cron job running on Ollama still compresses via cloud providers. Auto-inherit: when a cron job specifies a non-default provider, set CONTEXT_COMPRESSION_PROVIDER and AUXILIARY_COMPRESSION_BASE_URL env vars before creating the AIAgent. The auxiliary client resolution chain picks these up via _resolve_task_provider_model, so compression routes through the same provider as the job main model. Env vars are restored after the job completes. Closes NousResearch#5438
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
Cron jobs support per-job model/provider overrides for the main chat model, but compression always uses the global
compression.summary_modelfrom config.yaml. A cron job running on Ollama still compresses via cloud providers.Changes
Auto-inherit: when a cron job specifies a non-default provider (not auto/openrouter), set
CONTEXT_COMPRESSION_PROVIDERandAUXILIARY_COMPRESSION_BASE_URLenv vars before creating the AIAgent. The auxiliary client resolution chain picks these up via_resolve_task_provider_model, so compression routes through the same provider as the job's main model.Env vars are restored after the job completes.
Closes #5438
Part of #7605