Skip to content

[Bug]: Context compression causes incoherent responses on small-context models #7133

@ha7rock

Description

@ha7rock

Thanks for reporting a bug! Please fill out the sections below so we can reproduce and fix it quickly.

Before submitting, please:

  • Search existing issues to avoid duplicates
  • Update to the latest version (76 commits behind - not updated yet)

Bug Description

When Hermes uses a model with a small effective context window (e.g., MiniMax-M2.7), after auto context compression is triggered, the model becomes incoherent and gives completely irrelevant answers.

What happened: After context compression, the model ignores the user's current message and responds about something completely unrelated from earlier context.

Steps to Reproduce

  1. Have a conversation that grows large enough to trigger auto context compression
  2. After compression, send a new, clear, unambiguous user message (e.g., 'lan control,把我电视声音调低')
  3. The model responds about something unrelated (e.g., an audio file path from earlier context)

Expected Behavior

Model should acknowledge and act on the current user message.

Actual Behavior

Model responds about something unrelated. Example:

  • User: 'lan control,把我电视声音调低' (lower TV volume)
  • Model response: Talks about an audio file 'yt_30s_doc.mp3' — completely unrelated

Affected Component

  • Agent Core (conversation loop, context compression, memory)

Operating System

Ubuntu 24.04 (Linux 6.17.0)

Python Version

3.11.15

Hermes Version

v0.8.0

Root Cause Analysis (suspected)

After compression, the model doesn't re-read or properly acknowledge the user's last message before responding. It relies on residual context fragments and generates a plausible but wrong answer.

Proposed Fix

After context compression, the model should explicitly confirm the user's last message before generating a response, or the compression logic should preserve a summary of the most recent user intent.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions