Skip to content

[ML] Write Chat Completion JSON (#128592)#128642

Merged
elasticsearchmachine merged 3 commits intoelastic:8.19from
prwhelan:backport/8.19/128592
May 30, 2025
Merged

[ML] Write Chat Completion JSON (#128592)#128642
elasticsearchmachine merged 3 commits intoelastic:8.19from
prwhelan:backport/8.19/128592

Conversation

@prwhelan
Copy link
Copy Markdown
Member

Backport #128592

Most providers write the UnifiedCompletionRequest JSON as we received
it, with some exception:
- the modelId can be null and/or overwritten from various locations
- `max_completion_tokens` repalced `max_tokens`, but some providers
  still use the deprecated field name
We will handle the variations using Params, otherwise all of the
XContent building code has moved into UnifiedCompletionRequest so it can
be reused across providers.
@prwhelan prwhelan added >refactoring :ml Machine learning backport Team:ML Meta label for the ML team auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) v8.19.0 labels May 29, 2025
@prwhelan prwhelan marked this pull request as ready for review May 29, 2025 20:47
@elasticsearchmachine elasticsearchmachine merged commit 0c2e90a into elastic:8.19 May 30, 2025
15 checks passed
@prwhelan prwhelan deleted the backport/8.19/128592 branch May 30, 2025 18:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport :ml Machine learning >refactoring Team:ML Meta label for the ML team v8.19.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants