Skip to content

[ML] AIOps: Fix text field candidate selection for log rate analysis.#179699

Merged
walterra merged 4 commits intoelastic:mainfrom
walterra:ml-aiops-fix-field-candidates
Mar 29, 2024
Merged

[ML] AIOps: Fix text field candidate selection for log rate analysis.#179699
walterra merged 4 commits intoelastic:mainfrom
walterra:ml-aiops-fix-field-candidates

Conversation

@walterra
Copy link
Copy Markdown
Contributor

@walterra walterra commented Mar 29, 2024

Summary

Related to the investigation in elastic/elasticsearch#106166.

We had code in place that would check if a field was both mapped as keyword and text but it turns out there was a bug so we selected text fields even with a corresponding keyword field present.

This PR fixes the problem and adds a jest test that covers it.

Checklist

@walterra walterra added bug Fixes for quality problems that affect the customer experience release_note:fix :ml Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis v8.14.0 v8.13.1 labels Mar 29, 2024
@walterra walterra self-assigned this Mar 29, 2024
@walterra walterra marked this pull request as ready for review March 29, 2024 15:58
@walterra walterra requested a review from a team as a code owner March 29, 2024 15:58
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/ml-ui (:ml)

@qn895
Copy link
Copy Markdown
Member

qn895 commented Mar 29, 2024

Code LGTM 🎉

Copy link
Copy Markdown
Contributor

@alvarezmelissa87 alvarezmelissa87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ⚡

@kibana-ci
Copy link
Copy Markdown

💚 Build Succeeded

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @walterra

@walterra walterra merged commit a8e2581 into elastic:main Mar 29, 2024
@kibanamachine
Copy link
Copy Markdown
Contributor

💔 All backports failed

Status Branch Result
8.13 Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 179699

Questions ?

Please refer to the Backport tool documentation

@walterra
Copy link
Copy Markdown
Contributor Author

💚 All backports created successfully

Status Branch Result
8.13

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

walterra added a commit to walterra/kibana that referenced this pull request Mar 29, 2024
…elastic#179699)

(cherry picked from commit a8e2581)

# Conflicts:
#	x-pack/plugins/aiops/server/routes/log_rate_analysis/queries/__mocks__/field_caps_ecommerce.ts
#	x-pack/plugins/aiops/server/routes/log_rate_analysis/queries/__mocks__/field_caps_large_arrays.ts
#	x-pack/plugins/aiops/server/routes/log_rate_analysis/queries/__mocks__/field_caps_pgbench.ts
#	x-pack/plugins/aiops/server/routes/log_rate_analysis/queries/fetch_index_info.ts
walterra added a commit that referenced this pull request Mar 29, 2024
…alysis. (#179699) (#179719)

# Backport

This will backport the following commits from `main` to `8.13`:
- [[ML] AIOps: Fix text field candidate selection for log rate analysis.
(#179699)](#179699)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Walter
Rafelsberger","email":"walter.rafelsberger@elastic.co"},"sourceCommit":{"committedDate":"2024-03-29T19:43:36Z","message":"[ML]
AIOps: Fix text field candidate selection for log rate analysis.
(#179699)","sha":"a8e2581f65cf587f019fbcc863184f2743a4afce","branchLabelMapping":{"^v8.14.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["bug","release_note:fix",":ml","Feature:ML/AIOps","v8.14.0","v8.13.1"],"number":179699,"url":"https://github.com/elastic/kibana/pull/179699","mergeCommit":{"message":"[ML]
AIOps: Fix text field candidate selection for log rate analysis.
(#179699)","sha":"a8e2581f65cf587f019fbcc863184f2743a4afce"}},"sourceBranch":"main","suggestedTargetBranches":["8.13"],"targetPullRequestStates":[{"branch":"main","label":"v8.14.0","labelRegex":"^v8.14.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/179699","number":179699,"mergeCommit":{"message":"[ML]
AIOps: Fix text field candidate selection for log rate analysis.
(#179699)","sha":"a8e2581f65cf587f019fbcc863184f2743a4afce"}},{"branch":"8.13","label":"v8.13.1","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
@mistic mistic added v8.13.2 and removed v8.13.1 labels Apr 2, 2024
@mistic
Copy link
Copy Markdown
Contributor

mistic commented Apr 2, 2024

This PR didn't land on time of the latest BC for v8.13.1. Updating the labels.

@walterra walterra deleted the ml-aiops-fix-field-candidates branch April 3, 2024 08:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Fixes for quality problems that affect the customer experience Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis :ml release_note:fix v8.13.2 v8.14.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants