Skip to content

Adds missing model Claude 3.7 to accepted models#224943

Merged
seanhandley merged 2 commits intomainfrom
add_claude37_model_definition
Jun 25, 2025
Merged

Adds missing model Claude 3.7 to accepted models#224943
seanhandley merged 2 commits intomainfrom
add_claude37_model_definition

Conversation

@seanhandley
Copy link
Copy Markdown
Contributor

@seanhandley seanhandley commented Jun 23, 2025 •
edited by kibanamachine
Loading

Summary

With the new Claude 3.7 Elastic Managed LLM we're seeing an unhandled error in Kibana playground. We can reproduce it by:

  1. Indexing few but very large documents in Elasticsearch (10 docs, each 7mb)
  2. Setting the docs to send setting as 10
  3. Setting context to always query the index (I think there is some function calling, not sure what happens under the hood but this worked as I wanted to consistently).

image

Thread: https://elastic.slack.com/archives/C08DT72KR6J/p1750686748616369?thread_ts=1750685837.561949&cid=C08DT72KR6J

We're not 100% sure this fixes the issue but we do know the model should be added.

Checklist

Check the PR satisfies following conditions.

  • Cannot reproduce the issue after the model entry is used on QA environment

Reviewers should verify this PR satisfies this list as well.

  • The PR description includes the appropriate Release Notes section, and the correct release_note:* label is applied per the guidelines

Identify risks

No known risks

@seanhandley seanhandley requested a review from a team as a code owner June 23, 2025 18:29
@seanhandley seanhandley self-assigned this Jun 23, 2025
@seanhandley seanhandley requested a review from jaybcee June 23, 2025 18:29
@seanhandley seanhandley added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting v9.0.0 Team:Search backport:version Backport to applied version labels v9.1.0 v8.19.0 release_note:fix and removed release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting labels Jun 23, 2025
@seanhandley seanhandley changed the title Add Claude 3.7 to accepted models Adds missing model Claude 3.7 to accepted models Jun 23, 2025
@seanhandley seanhandley force-pushed the add_claude37_model_definition branch from ff864cd to 23be95a Compare June 25, 2025 10:38
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jun 25, 2025 •
edited
Loading

💚 Build Succeeded

  • Buildkite Build
  • Commit: 23be95a
  • Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-224943-23be95ab44b0

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
searchPlayground 196.6KB 196.7KB +131.0B

History

cc @seanhandley

@seanhandley seanhandley merged commit b3d0800 into main Jun 25, 2025
10 checks passed
@seanhandley seanhandley deleted the add_claude37_model_definition branch June 25, 2025 12:26
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jun 25, 2025

Starting backport for target branches: 8.19, 9.0

https://github.com/elastic/kibana/actions/runs/15876293271

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jun 25, 2025

💔 All backports failed

Status Branch Result
❌ 8.19 Backport failed because of merge conflicts

You might need to backport the following PRs to 8.19:
- Upgrading pbkdf2 (#225160)
- [Cases] Add incremental id service and expose the ID in the UI (#222874)
- [Data Streams] Fix forward-compatibility api test failures (#224795)
- [Security Assistant] Starter prompts (#224981)
- FIX - Failing test: Stateful Observability - Deployment-agnostic Feature Flag API Integration Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts - Stateful Observability feature flag testing - Deployment-agnostic API integration tests SyntheticsCustomStatusRule "after all" hook in "SyntheticsCustomStatusRule" (#225090)
- ES|QL pattern formatting (#222871)
- [Synthetics] Multi space monitors !! (#221568)
- [Response Ops][Task Manager] Skip API Key Tasks If Security is Disabled (#221732)
- [Attack discovery] Optionally update the kibana.alert.workflow_status of alerts associated with Attack discoveries (#225029)
❌ 9.0 Backport failed because of merge conflicts

You might need to backport the following PRs to 9.0:
- Upgrading pbkdf2 (#225160)
- FIX - Failing test: Stateful Observability - Deployment-agnostic Feature Flag API Integration Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts - Stateful Observability feature flag testing - Deployment-agnostic API integration tests SyntheticsCustomStatusRule "after all" hook in "SyntheticsCustomStatusRule" (#225090)

Manual backport

To create the backport manually run:

node scripts/backport --pr 224943

Questions ?

Please refer to the Backport tool documentation

This was referenced Jun 26, 2025
Merged
Merged
Merged
Merged
@kibanamachine kibanamachine added the backport missing Added to PRs automatically when the are determined to be missing a backport. label Jun 27, 2025
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jun 27, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jun 30, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

4 similar comments
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jul 1, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jul 2, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jul 3, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jul 4, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

@seanhandley seanhandley removed their assignment Jul 4, 2025
@seanhandley seanhandley removed release_note:fix backport missing Added to PRs automatically when the are determined to be missing a backport. v9.0.0 Team:Search ci:build-serverless-image backport:version Backport to applied version labels v9.1.0 v8.19.0 labels Jul 4, 2025
@kibanamachine kibanamachine added the backport missing Added to PRs automatically when the are determined to be missing a backport. label Jul 7, 2025
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jul 7, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

1 similar comment
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Jul 8, 2025

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create automatically backports add a backport:* label or prevent reminders by adding the backport:skip label.
You can also create backports manually by running node scripts/backport --pr 224943 locally
cc: @seanhandley

@seanhandley seanhandley added the backport:skip This PR does not require backporting label Jul 9, 2025
@kibanamachine kibanamachine removed the backport missing Added to PRs automatically when the are determined to be missing a backport. label Jul 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@pgayvallet pgayvallet pgayvallet approved these changes

@jaybcee jaybcee Awaiting requested review from jaybcee

Assignees

No one assigned

Labels

backport:skip This PR does not require backporting

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@seanhandley @elasticmachine @kibanamachine @pgayvallet @jaybcee