-
Notifications
You must be signed in to change notification settings - Fork 38.3k
Closed
Labels
feature-requestRequest for new features or functionalityRequest for new features or functionalityinline-chat-v2on-release-notesIssue/pull request mentioned in release notesIssue/pull request mentioned in release noteson-testplan
Milestone
Description
The inlineChat.enableV2 controls how the chat extension computes edits for inline chat. This is tool based and uses less pre-processing/filtering before making request. This means responses are generally of higher quality but it also means that responses are often slower (due to the tool calling overhead of extra tokens and so). This item is about optimising the new backend without loosing its new powers
Some ideas
- disable intent detection
- use cache-breakoints
- show progress about editing
- in select cases use the good parts of the old approach
- use the prediction field
- don't always enable
MultiReplaceStringtool - explore a replace_selection tool #280907
- better UI that makes waiting more pleasant
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
feature-requestRequest for new features or functionalityRequest for new features or functionalityinline-chat-v2on-release-notesIssue/pull request mentioned in release notesIssue/pull request mentioned in release noteson-testplan