Skip to content

[ML-DataFrame] Checkpoint information is wrong for stopped dataframes #42978

@hendrikmuhs

Description

@hendrikmuhs

For stopped data frames the checkpoint information is taken from the stored stats document in the internal index rather than calculated. The stored information is always empty, therefore it always reports 0:

     "checkpointing" : {
        "operations_behind" : 0
      }

Solution:

  • calculate checkpoint information the same ways as it's done for started data frames
  • do not persist checkpoint information in the state-and-stats document in the internal index

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions