Skip to content

fix(gateway): add platform notes to prevent hallucinated capabilities#1184

Merged
teknium1 merged 1 commit into
mainfrom
hermes/hermes-31d07af4
Mar 13, 2026
Merged

fix(gateway): add platform notes to prevent hallucinated capabilities#1184
teknium1 merged 1 commit into
mainfrom
hermes/hermes-31d07af4

Conversation

@teknium1

Copy link
Copy Markdown
Contributor

Summary

Adds platform-specific behavioral notes to the session context prompt for Slack and Discord. This tells the agent what it cannot do on each platform, preventing it from hallucinating capabilities and promising actions it can't deliver.

The problem

A user reported that the agent says things like "I'll search your Slack history" or "I'll pin that message" — then goes silent because no Slack-specific tools exist. The agent pattern-matches on the request and generates a plausible-sounding response, but has no way to follow through.

The fix

When the agent runs on Slack or Discord, the session context prompt now includes:

Platform notes: You are running inside Slack. You do NOT have access to Slack-specific APIs — you cannot search channel history, pin/unpin messages, manage channels, or list users. Do not promise to perform these actions.

This is lightweight (a few lines in the system prompt) and prevents the hallucination without adding any tools to the context budget.

Files changed

  • gateway/session.py — Platform-specific notes in build_session_context_prompt()
  • tests/gateway/test_session.py — Tests for Slack and Discord platform notes

Test plan

python -m pytest tests/gateway/test_session.py -n0 -q

683 gateway tests pass, 0 regressions.

Tell the agent what it CANNOT do on Slack and Discord — no searching
channel history, no pinning messages, no managing channels/roles.
Prevents the agent from hallucinating capabilities it doesn't have
and promising actions it can't deliver.

Addresses user feedback: agent says 'I'll search your Slack history'
then goes silent because no Slack-specific tools exist.
@teknium1 teknium1 merged commit c8bfb1d into main Mar 13, 2026
1 check failed
angelburgosrosado pushed a commit to angelburgosrosado/hermes-agent that referenced this pull request Apr 27, 2026
…ousResearch#1184)

Tell the agent what it CANNOT do on Slack and Discord — no searching
channel history, no pinning messages, no managing channels/roles.
Prevents the agent from hallucinating capabilities it doesn't have
and promising actions it can't deliver.

Addresses user feedback: agent says 'I'll search your Slack history'
then goes silent because no Slack-specific tools exist.
02356abc pushed a commit to 02356abc/hermes-agent that referenced this pull request May 14, 2026
…ousResearch#1184)

Tell the agent what it CANNOT do on Slack and Discord — no searching
channel history, no pinning messages, no managing channels/roles.
Prevents the agent from hallucinating capabilities it doesn't have
and promising actions it can't deliver.

Addresses user feedback: agent says 'I'll search your Slack history'
then goes silent because no Slack-specific tools exist.
olympus-terminal pushed a commit to olympus-terminal/hermes-agent that referenced this pull request May 16, 2026
…ousResearch#1184)

Tell the agent what it CANNOT do on Slack and Discord — no searching
channel history, no pinning messages, no managing channels/roles.
Prevents the agent from hallucinating capabilities it doesn't have
and promising actions it can't deliver.

Addresses user feedback: agent says 'I'll search your Slack history'
then goes silent because no Slack-specific tools exist.
Egavasyug pushed a commit to Egavasyug/hermes-agent that referenced this pull request Jun 10, 2026
…ousResearch#1184)

Tell the agent what it CANNOT do on Slack and Discord — no searching
channel history, no pinning messages, no managing channels/roles.
Prevents the agent from hallucinating capabilities it doesn't have
and promising actions it can't deliver.

Addresses user feedback: agent says 'I'll search your Slack history'
then goes silent because no Slack-specific tools exist.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant