feat (ai): allow using provider default temperature by specifying null#5890
Merged
feat (ai): allow using provider default temperature by specifying null#5890
Conversation
4 tasks
gr2m
reviewed
Apr 23, 2025
|
|
||
| const result = await middleware.transformParams!({ | ||
| type: 'generate', | ||
| params: { ...BASE_PARAMS, temperature: undefined }, |
Collaborator
Author
|
yes we can refine e.g. with string alternatives as discussed |
samdenty
pushed a commit
that referenced
this pull request
Apr 24, 2025
…ining2 * origin/v5: (25 commits) chore(providers/langchain): extract to separate package (#5928) Version Packages (canary) (#5898) fix (docs): fix typo (#5914) (#5919) docs: update chat-with-pdf page to include updated provider information (#5895) (#5917) docs: Added documentation for function call parsing middleware (#5900) refactoring: extract SharedV2Headers (#5912) feat (providers/openai): add support for reasoning summaries (#5906) (#5909) fix (docs): fix OpenRouter code examples (#5876) (#5893) fix(providers/xai): return actual usage when streaming instead of NaN (#5873) (#5891) fix (docs): fix valibotSchema import (#5865) (#5889) fix (providers/fal): improve model compatibility (#5855) (#5892) chore: extract spec types (#5901) chore: remove logprobs (#5896) Version Packages (canary) (#5872) chore (ci): unify jobs & remove unnecessary example builds (#5894) feat (ai): allow using provider default temperature by specifying null (#5890) fix(ai/mcp-stdio): make `createChildProcess` synchronous to prevent spawn race condition (#5852) (#5888) feat (providers/google): add thinking config to provider options (#5842) (#5887) fix (examples): avoid mixed message types in `use-chat-streamdata-multistep` (#5824) (#5886) chore: restructure language model supported urls (#5882) ...
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Background
For many models,
0temperature is a great default, because it leads to more stable outputs. However, certain models, in particular reasoning models, require the temperature to beundefinedor1. We reset those values automatically in the providers based on the model, but it is also desirable to have a way to reset the temperature to the provider default.Summary
Enable users to use the provider default temperature by specifying
null. Extend default settings middleware to allow for models with overrides.