Skip to content

[Data] "Task Completion Time Without Backpressure" Grafana panel is broken #60163

@bveeramani

Description

@bveeramani

The "Task Completion Time Without Backpressure" metrics chart is broken.

I think it's because #57788 renamed task_completion_time_without_backpressure without updating the associated code in data_dashboard_panels.py:

TASK_COMPLETION_TIME_WITHOUT_BACKPRESSURE_PANEL = Panel(
id=40,
title="Task Completion Time Without Backpressure",
description="Average time (in seconds) tasks spend executing their core logic, excluding backpressure, over a recent 5-minute window. This metric helps isolate actual computation time from delays caused by data flow bottlenecks, aiding in differentiating between computation-bound and data-flow-bound performance issues.",
unit="s",
targets=[
Target(
expr='increase(ray_data_task_completion_time_without_backpressure{{{global_filters}, operator=~"$Operator"}}[5m]) / increase(ray_data_num_tasks_finished{{{global_filters}, operator=~"$Operator"}}[5m])',
legend="Task Completion Time w/o Backpressure: {{dataset}}, {{operator}}",
),
],
fill=0,
stack=False,
)

What you need to do:

  • Update the Grafana panel definition to use the correct name in the expr
  • Run a simple Ray Data job and ensure the panel works correctly.

Metadata

Metadata

Assignees

Labels

P1Issue that should be fixed within a few weeksbugSomething that is supposed to be working; but isn'tdataRay Data-related issues

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions