Checklist
Describe the bug
Using sglang to deploy a large model with tp=16, dp=2 across two servers, so two requests will run on dp0-7 and dp8-15 respectively.
Then, executing curl -X GET http://0.0.0.0:40000/metrics -H "Authorization: Bearer xxxx" on servers A and B:
Server A (master node) has metrics, but Server B does not.
Both A and B have enable_metrics in their configurations.
What should I do?
Reproduction
curl -X GET http://0.0.0.0:40000/metrics -H "Authorization: Bearer xxxx" on Server B ,return {"detail":"Not Found"}
Environment
sglang v.0.4.6
linux :ubuntu
model:deepseek r1
Checklist
Describe the bug
Using sglang to deploy a large model with tp=16, dp=2 across two servers, so two requests will run on dp0-7 and dp8-15 respectively.
Then, executing curl -X GET http://0.0.0.0:40000/metrics -H "Authorization: Bearer xxxx" on servers A and B:
Server A (master node) has metrics, but Server B does not.
Both A and B have enable_metrics in their configurations.
What should I do?
Reproduction
curl -X GET http://0.0.0.0:40000/metrics -H "Authorization: Bearer xxxx" on Server B ,return {"detail":"Not Found"}
Environment
sglang v.0.4.6
linux :ubuntu
model:deepseek r1