feat(anthropic): context management by shubham-021 · Pull Request #10540 · vercel/ai

shubham-021 · 2025-11-24T17:32:08Z

Background

Anthropic's now supports context management to automatically clear conversation history when approaching token limits. This prevents model_context_window_exceeded errors and enables longer conversations by removing older tool uses or thinking blocks while preserving recent context.

See https://platform.claude.com/docs/en/build-with-claude/context-editing

Summary

Added the context management feature for anthropic:

Added context_management configuration to provider options
Implemented clear_tool_uses_20250919 and clear_thinking_20251015 strategies
Parse and expose applied context edits in response metadata
Map model_context_window_exceeded stop reason to 'length'
Added tests and updated snapshots

Checklist

Tests have been added / updated (for bug fixes / features)
Documentation has been added / updated (for bug fixes / features)
A patch changeset for relevant packages has been added (for bug fixes / features - run pnpm changeset in the project root)
I have reviewed this pull request (self-review)

Related Issues

Fixes #10485

packages/anthropic/src/anthropic-messages-language-model.ts

packages/anthropic/src/anthropic-messages-options.ts

gr2m

could you please add an example for manual testing? e.g. examples/ai-core/src/generate-text/anthropic-context-management.ts

Also the ## Manual Verification section in your pull request templates is very important. For this particular case, I would add or alter an existing example to examples/next-openai (ignore the openai in the name, we have lots of other provider examples in there) and then test it extensively with multi-turn chats

examples/ai-core/src/generate-text/anthropic-context-management.ts

packages/anthropic/src/anthropic-messages-language-model.ts

lgrammel · 2025-11-25T11:45:21Z

a) code style seems to be off, unclear why prettier is not running
b) adding a section to the anthropic provider docs content/providers/01-ai-sdk-providers/05-anthropic.mdx would be very useful

shubham-021 · 2025-11-25T14:07:01Z

a) code style seems to be off, unclear why prettier is not running b) adding a section to the anthropic provider docs content/providers/01-ai-sdk-providers/05-anthropic.mdx would be very useful

I have applied the changes to the doc and replaced the if-else logic with switch case , but i can not say about the issue regarding prettier , i ran pnpm prettier-fix on my machine , and it ran successfully.

content/providers/01-ai-sdk-providers/05-anthropic.mdx

gr2m · 2025-11-29T18:23:14Z

@shubham-021 hey just a quick note: please don't force-push changes once we started reviewing, it will make us loose track of what we already reviewed and what changed since the last review

gr2m · 2025-11-29T18:24:50Z

could you help us resolving the conflict?

Resolved conflicts in anthropic-messages-language-model.ts by: - Keeping context management variable declaration and logic - Preserving upstream URL variable and other changes - Maintaining context management parsing in doGenerate() and doStream() All tests passing.

shubham-021 · 2025-11-30T09:16:52Z

@gr2m i have updated the branch , this should do now

shubham-021 · 2025-12-02T15:17:09Z

@gr2m I have resolved the conflicts again , can you please review this ?

lgrammel · 2025-12-07T11:47:30Z

packages/anthropic/src/anthropic-messages-language-model.ts

+
+                                default:
+                                  throw new Error(
+                                    `Unknown strategy: ${strategy}`,


can you add a warning insterad of throwing an error

packages/anthropic/src/__snapshots__/anthropic-messages-language-model.test.ts.snap

lgrammel · 2025-12-07T11:49:11Z

Looks pretty close, please add a couple of unit tests and also change the error to a warning

lgrammel · 2025-12-08T10:24:16Z

Please do not change the branch any more; I'll make a few last edits so we can get this merged.

shubham-021 · 2025-12-08T10:45:01Z

Please do not change the branch any more; I'll make a few last edits so we can get this merged.

I modified the type AnthropicResponseClearToolUsesEdit in order to implement 'warning' in place of throwing an error , thats what causing this issue .

…ntext editing (#12547) ## Background Anthropic context management support (`clear_tool_uses`, `clear_thinking`) was added in #10540 (with a related fix in #12154), and compaction support (`compact`) was added in #12384. ## Summary With the complexities of handling these features correctly (including how `clear_tool_uses` and `clear_thinking` can be combined), I think it makes sense to add some more tests and also examples around this. - Adds fixture based tests for context editing (tool uses, thinking, and both combined), each for `generateText` and `streamText` - Adds examples for thinking, compaction, and thinking and tool uses combined (there already was an example for tool uses alone, which I renamed for consistency) - Expands docs, adding "Context Editing" grouping section for both `clear_thinking` and `clear_tool_uses` ## Manual Verification All examples were run against the live Anthropic API to verify correct behavior, and the fixture data was captured from those real API responses. ## Checklist - [x] Tests have been added / updated (for bug fixes / features) - [x] Documentation has been added / updated (for bug fixes / features) - [ ] A _patch_ changeset for relevant packages has been added (for bug fixes / features - run `pnpm changeset` in the project root) - [x] I have reviewed this pull request (self-review) ## Future Work N/A ## Related Issues N/A

vercel-ai-sdk bot added ai/provider related to a provider package. Must be assigned together with at least one `provider/*` label provider/anthropic Issues related to the @ai-sdk/anthropic provider labels Nov 24, 2025

gr2m self-assigned this Nov 24, 2025

vercel bot reviewed Nov 24, 2025

View reviewed changes

packages/anthropic/src/anthropic-messages-language-model.ts Outdated Show resolved Hide resolved

gr2m reviewed Nov 24, 2025

View reviewed changes

packages/anthropic/src/anthropic-messages-options.ts Outdated Show resolved Hide resolved

gr2m reviewed Nov 24, 2025

View reviewed changes

packages/anthropic/src/anthropic-messages-options.ts Outdated Show resolved Hide resolved

gr2m reviewed Nov 24, 2025

View reviewed changes

shubham-021 force-pushed the feat/anthropic_context_management branch from 834eb48 to d403f29 Compare November 24, 2025 22:42

vercel bot reviewed Nov 24, 2025

View reviewed changes

examples/ai-core/src/generate-text/anthropic-context-management.ts Outdated Show resolved Hide resolved

lgrammel reviewed Nov 25, 2025

View reviewed changes

packages/anthropic/src/anthropic-messages-language-model.ts Outdated Show resolved Hide resolved

shubham-021 force-pushed the feat/anthropic_context_management branch from 1d04abb to 91c8ca6 Compare November 25, 2025 13:59

vercel bot reviewed Nov 25, 2025

View reviewed changes

content/providers/01-ai-sdk-providers/05-anthropic.mdx Show resolved Hide resolved

shubham-021 added 8 commits November 25, 2025 20:07

feat/context_management

88cefa1

test/add_tests_for_context_management

fc3201d

fix/snake_case to camelCase

0af1195

add example for anthropic context management

54f6a0c

fix and resolve conflicts

8dec952

fix(style): Use camelCase for contextManagement

270d08d

add doc and refactor to switch

120dba8

docs: Fix incorrect field names

927049f

shubham-021 force-pushed the feat/anthropic_context_management branch from 32753a7 to 927049f Compare November 25, 2025 14:40

shubham-021 requested review from gr2m and lgrammel November 26, 2025 07:58

Merge branch 'main' into feat/anthropic_context_management

7d66285

shubham-021 added 2 commits December 2, 2025 20:35

Merge upstream/main into feat/anthropic_context_management

c312c18

prettier-fix

abf5d8c

lgrammel reviewed Dec 7, 2025

View reviewed changes

packages/anthropic/src/__snapshots__/anthropic-messages-language-model.test.ts.snap Show resolved Hide resolved

Merge branch 'main' into feat/anthropic_context_management

faf04a0

shubham-021 and others added 4 commits December 8, 2025 13:00

Merge branch 'main' into feat/anthropic_context_management

7c61c56

warning instead of throwing an error

3003c4c

add unit tests for context management request mapping

777ec2e

prettier-fix

1824f46

lgrammel added 6 commits December 8, 2025 11:29

d

bbdc915

x

fde6270

x

173de35

x

cace34f

rm

5328737

e

86cc883

lgrammel changed the title ~~feat(anthropic) : implement context_management~~ feat(anthropic) : context management Dec 8, 2025

lgrammel changed the title ~~feat(anthropic) : context management~~ feat(anthropic): context management Dec 8, 2025

lgrammel approved these changes Dec 8, 2025

View reviewed changes

lgrammel merged commit b2dbfbf into vercel:main Dec 8, 2025
17 of 18 checks passed

shubham-021 deleted the feat/anthropic_context_management branch December 10, 2025 10:46

felixarntz mentioned this pull request Feb 13, 2026

test(provider/anthropic): add fixture-based tests and examples for context editing #12547

Merged

4 tasks

Conversation

shubham-021 commented Nov 24, 2025 • edited by lgrammel Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Background

Summary

Checklist

Related Issues

Uh oh!

Uh oh!

Uh oh!

Uh oh!

gr2m left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

lgrammel commented Nov 25, 2025

Uh oh!

shubham-021 commented Nov 25, 2025

Uh oh!

Uh oh!

gr2m commented Nov 29, 2025

Uh oh!

gr2m commented Nov 29, 2025

Uh oh!

shubham-021 commented Nov 30, 2025

Uh oh!

shubham-021 commented Dec 2, 2025

Uh oh!

lgrammel Dec 7, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

lgrammel commented Dec 7, 2025

Uh oh!

lgrammel commented Dec 8, 2025

Uh oh!

shubham-021 commented Dec 8, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

shubham-021 commented Nov 24, 2025 •

edited by lgrammel

Loading