Skip to content

update serve autoscaling docs#57652

Merged
zcin merged 7 commits intomasterfrom
autoscaling-docs
Oct 15, 2025
Merged

update serve autoscaling docs#57652
zcin merged 7 commits intomasterfrom
autoscaling-docs

Conversation

@abrarsheikh
Copy link
Copy Markdown
Contributor

@abrarsheikh abrarsheikh commented Oct 12, 2025

This PR fixes critical documentation gaps and inaccuracies in Ray Serve autoscaling docs. Key additions include the previously undocumented aggregation_function parameter, 9 autoscaling environment variables, and a comprehensive "How autoscaling metrics work" section with diagrams explaining the 4-stage metrics pipeline. The PR also corrects the record_autoscaling_stats() timeout value (10s not 30s), clarifies the two-stage downscaling behavior, and fixes the max_replicas default value explanation. Additionally, it adds deprecation notices for simple mode→aggregate mode and handle-based→replica-based metrics collection transitions.

Signed-off-by: abrar <abrar@anyscale.com>
@abrarsheikh abrarsheikh added the go add ONLY when ready to merge, run all tests label Oct 12, 2025
Signed-off-by: abrar <abrar@anyscale.com>
Signed-off-by: abrar <abrar@anyscale.com>
@abrarsheikh abrarsheikh marked this pull request as ready for review October 12, 2025 23:24
@abrarsheikh abrarsheikh requested review from a team as code owners October 12, 2025 23:24
@ray-gardener ray-gardener bot added serve Ray Serve Related Issue docs An issue or change related to documentation labels Oct 13, 2025
Copy link
Copy Markdown
Contributor

@akshay-anyscale akshay-anyscale left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just one comment, otherwise lgtm

@zcin zcin merged commit 4269a18 into master Oct 15, 2025
6 checks passed
@zcin zcin deleted the autoscaling-docs branch October 15, 2025 04:20
justinyeh1995 pushed a commit to justinyeh1995/ray that referenced this pull request Oct 20, 2025
xinyuangui2 pushed a commit to xinyuangui2/ray that referenced this pull request Oct 22, 2025
Signed-off-by: xgui <xgui@anyscale.com>
elliot-barn pushed a commit that referenced this pull request Oct 23, 2025
Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
landscapepainter pushed a commit to landscapepainter/ray that referenced this pull request Nov 17, 2025
Aydin-ab pushed a commit to Aydin-ab/ray-aydin that referenced this pull request Nov 19, 2025
Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Future-Outlier pushed a commit to Future-Outlier/ray that referenced this pull request Dec 7, 2025
Signed-off-by: Future-Outlier <eric901201@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs An issue or change related to documentation go add ONLY when ready to merge, run all tests serve Ray Serve Related Issue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants