Skip to content

Reindex metrics can be inaccurate with slicing enabled #138258

@samxbr

Description

@samxbr

Elasticsearch Version

8.16+ (Reindex metrics introduced in 8.16)

Problem Description

Reindex metrics are currently emitted per slice if slicing is enabled, and emitted per whole operation if slicing is disabled. This leads to confusion because the meaning of metric like es.reindex.duration.histogram are different based on whether slicing is used in a reindex operation. It also leads to inaccurate metrics as the metrics for per operation and per slice are mixed together.

Steps to Reproduce

Add slicing (eg. reindex().setSlices(5).source("source")...) in this test will cause the test to fail with 5 metric counts instead of 1.

Metadata

Metadata

Assignees

Labels

:Distributed/ReindexIssues relating to reindex that are not caused by issues further down>bugTeam:DistributedMeta label for distributed team.

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions