Skip to content

add telemetry usage for async inference#57665

Merged
zcin merged 2 commits intomasterfrom
add-telemetry-serve-usage
Oct 17, 2025
Merged

add telemetry usage for async inference#57665
zcin merged 2 commits intomasterfrom
add-telemetry-serve-usage

Conversation

@harshit-anyscale
Copy link
Copy Markdown
Contributor

  • add telemetry to track number of replicas using asynchronous inference

Signed-off-by: harshit <harshit@anyscale.com>
@harshit-anyscale harshit-anyscale requested a review from a team as a code owner October 13, 2025 04:32
@harshit-anyscale harshit-anyscale self-assigned this Oct 13, 2025
@harshit-anyscale harshit-anyscale added the go add ONLY when ready to merge, run all tests label Oct 13, 2025
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adds telemetry to track the number of replicas using asynchronous inference. The implementation is straightforward, but there is a recurring typo ('INFERNCE' instead of 'INFERENCE') in the new telemetry tag name across both modified files. I've suggested corrections for these typos.

cursor[bot]

This comment was marked as outdated.

Signed-off-by: harshit <harshit@anyscale.com>
@ray-gardener ray-gardener bot added serve Ray Serve Related Issue observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling labels Oct 13, 2025
@zcin zcin merged commit 61a4e7e into master Oct 17, 2025
6 checks passed
@zcin zcin deleted the add-telemetry-serve-usage branch October 17, 2025 13:13
justinyeh1995 pushed a commit to justinyeh1995/ray that referenced this pull request Oct 20, 2025
- add telemetry to track number of replicas using asynchronous inference

---------

Signed-off-by: harshit <harshit@anyscale.com>
xinyuangui2 pushed a commit to xinyuangui2/ray that referenced this pull request Oct 22, 2025
- add telemetry to track number of replicas using asynchronous inference

---------

Signed-off-by: harshit <harshit@anyscale.com>
Signed-off-by: xgui <xgui@anyscale.com>
elliot-barn pushed a commit that referenced this pull request Oct 23, 2025
- add telemetry to track number of replicas using asynchronous inference

---------

Signed-off-by: harshit <harshit@anyscale.com>
Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
landscapepainter pushed a commit to landscapepainter/ray that referenced this pull request Nov 17, 2025
- add telemetry to track number of replicas using asynchronous inference

---------

Signed-off-by: harshit <harshit@anyscale.com>
Aydin-ab pushed a commit to Aydin-ab/ray-aydin that referenced this pull request Nov 19, 2025
- add telemetry to track number of replicas using asynchronous inference

---------

Signed-off-by: harshit <harshit@anyscale.com>
Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Future-Outlier pushed a commit to Future-Outlier/ray that referenced this pull request Dec 7, 2025
- add telemetry to track number of replicas using asynchronous inference

---------

Signed-off-by: harshit <harshit@anyscale.com>
Signed-off-by: Future-Outlier <eric901201@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

go add ONLY when ready to merge, run all tests observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling serve Ray Serve Related Issue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants