Skip to content

[inference] increase timeout for inference calls#260267

Merged
pgayvallet merged 3 commits intoelastic:mainfrom
pgayvallet:ab-xxx-inference-timeout
Mar 30, 2026
Merged

[inference] increase timeout for inference calls#260267
pgayvallet merged 3 commits intoelastic:mainfrom
pgayvallet:ab-xxx-inference-timeout

Conversation

@pgayvallet
Copy link
Copy Markdown
Contributor

Summary

Because default of 30s is too short for some models

@pgayvallet pgayvallet added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting v9.4.0 labels Mar 30, 2026
@pgayvallet pgayvallet marked this pull request as ready for review March 30, 2026 13:57
@pgayvallet pgayvallet requested review from a team as code owners March 30, 2026 13:57
@pgayvallet
Copy link
Copy Markdown
Contributor Author

/ci

@pgayvallet
Copy link
Copy Markdown
Contributor Author

@elasticmachine merge upstream

@pgayvallet pgayvallet enabled auto-merge (squash) March 30, 2026 14:30
@elasticmachine
Copy link
Copy Markdown
Contributor

⏳ Build in-progress, with failures

Failed CI Steps

Test Failures

  • [job] [logs] Jest Tests #8 / InferenceConnector performApiCompletionStream signal is properly passed to streamApi
  • [job] [logs] Jest Tests #8 / InferenceConnector performApiCompletionStream signal is properly passed to streamApi
  • [job] [logs] Jest Tests #8 / InferenceConnector performApiCompletionStream the API call is successful with correct request parameters
  • [job] [logs] Jest Tests #8 / InferenceConnector performApiCompletionStream the API call is successful with correct request parameters
  • [job] [logs] Jest Tests #8 / InferenceConnector performApiUnifiedCompletion uses the chat_completion task_type is supplied
  • [job] [logs] Jest Tests #8 / InferenceConnector performApiUnifiedCompletion uses the chat_completion task_type is supplied
  • [job] [logs] FTR Configs #180 / serverless security UI Security ML Anomaly detection jobs list page navigation renders job list and finds created job

@pgayvallet pgayvallet force-pushed the ab-xxx-inference-timeout branch from 0b93594 to 93928a0 Compare March 30, 2026 15:15
@pgayvallet pgayvallet merged commit db9141c into elastic:main Mar 30, 2026
18 checks passed
pgayvallet added a commit that referenced this pull request Mar 31, 2026
## Summary

Follow-up of #260267
Turns out, we also need to increase the ES call's timeout
pgayvallet added a commit to pgayvallet/kibana that referenced this pull request Mar 31, 2026
Backports the stack_connectors changes from elastic#260267 and elastic#260382 to the
9.3 branch. Adds a 180s query-level timeout and 180s requestTimeout to
the ES inference chat_completion transport request.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
pgayvallet added a commit to pgayvallet/kibana that referenced this pull request Mar 31, 2026
Backports the stack_connectors changes from elastic#260267 and elastic#260382 to the
9.3 branch. Adds a 180s query-level timeout and 180s requestTimeout to
the ES inference chat_completion transport request.
pgayvallet added a commit that referenced this pull request Mar 31, 2026
## Summary

Backports the stack_connectors changes from #260267 and #260382 to the
9.3 branch.

- Adds `querystring: { timeout: '180s' }` to the ES inference
`chat_completion` transport request
- Adds `requestTimeout: 180_000` to the transport request options

The inference plugin changes from those PRs are not included as that
code doesn't exist on 9.3.

## Test plan

- [x] Unit tests pass (`inference.test.ts`)
jeramysoucy pushed a commit to jeramysoucy/kibana that referenced this pull request Apr 1, 2026
## Summary

Because default of 30s is too short for some models

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
jeramysoucy pushed a commit to jeramysoucy/kibana that referenced this pull request Apr 1, 2026
## Summary

Follow-up of elastic#260267
Turns out, we also need to increase the ES call's timeout
paulinashakirova pushed a commit to paulinashakirova/kibana that referenced this pull request Apr 2, 2026
## Summary

Because default of 30s is too short for some models

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
paulinashakirova pushed a commit to paulinashakirova/kibana that referenced this pull request Apr 2, 2026
## Summary

Follow-up of elastic#260267
Turns out, we also need to increase the ES call's timeout
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting release_note:skip Skip the PR/issue when compiling release notes v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants