Bug Description

Hermes defaults to 1M context window with no option to choose 200K. Claude Pro doesn't allow a context window bigger than 200K. Works fine until the limit is exceeded.

Steps to Reproduce

Setup Hermes to use an Anthropic account subscribed to the Pro plan.

Expected Behavior

It should default to a 200K context window

Actual Behavior

It default's to 1M

Affected Component

Setup / Installation

Messaging Platform (if gateway-related)

No response

Operating System

Arch Linux

Python Version

3.11.15

Hermes Version

0.5.0

Relevant Logs / Traceback

Root Cause Analysis (optional)

No response

Proposed Fix (optional)

Make it so we can choose the context window size from all the available options, either as a separate entry in the model picker or on another menu

Are you willing to submit a PR for this?

• I'd like to fix this myself and submit a PR