Remove inconsistent parameters in claude sonnet#11719
Conversation
fe31f3b to
589fa8d
Compare
|
@openhands-agent fix the lint problems please |
|
@OpenHands This PR fails linting, run a precommit on its files after you make build. Note that this branch is from a fork parentsquare:forward-litellm-args-for-drop-params, so you know where to commit. |
|
I'm on it! enyst can track my progress at all-hands.dev |
|
Out of curiosity, could you perhaps share some log @TuringND ? I’m a bit surprised it was Sonnet 4, because I’m pretty sure we used it extensively on OpenHands, without dropping top_p IIRC. 🤔 |
|
Summary of work What I did
Change details
Checklist against your instructions
Why push didn’t happen
Next step (needed from you)
|
This problem can be seen when setting I can make it more specific though I think the patch misses the |
@openhands-agent Can you add a suggestion commit comment with the changes please? |
I'm thinking on dropping this PR and creating a clean one out of the OpenHands remote instead of the fork with the lint problems fixed and addressing the Sonnet 4-5 only not Sonnet 4 @enyst . |
|
@TuringND Ah it’s Bedrock, that explains it, thank you! These can indeed vary per provider. As you wish, with the PR. I think running |
|
@TuringND I also wonder if maybe I'm wrong, and the condition under which you experience it has also something to do with extended_thinking... We've seen that before on Opus. More importantly, though, I really appreciate the fix because we need to fix this, the strange thing right now is that we're just about to transition this repository to V1, the next major version of OpenHands. It's merged already and a lot of work is actually going on on V1, it's just not enabled by default. That matters here because V1 is built on OpenHands Software Agent SDK, and it is in the SDK that LLM component is handled. So once we merge here, we need the fix in agent-sdk as well, or, if you'd like, the other way around. 😅 I would deeply appreciate if you want to port the fix! |
ea8e0a4 to
a0644bb
Compare
Thank you for your kind words, I've just forced-push the linting fix and I'll schedule some time to introduce this fix in the agent-sdk too. |
@enyst I started working on this and in a separated PR on token caching that fixes what we have experienced with Bedrock. I intended to ask you about the upgrade from 0.62 to v1 in headless mode. I'd better open a discussion issue ? |
Summary of PR
We found that you can either pass temperature or top_p to claude sonnet 4 models.
Change Type
Checklist
Fixes
Resolves #(issue)
Release Notes