List view

[Serve] Use concurrency group

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

P2Important issue, but not time-criticalImportant issue, but not time-critical

ray-team-createdRay Team createdRay Team created

serveRay Serve Related IssueRay Serve Related Issue

Status: Open.

#20054 In ray-project/ray;

· simon-mo opened on Nov 4, 2021

Update serve deployment FastAPI docs to make clear all steps needed to update endpoint

docsAn issue or change related to documentationAn issue or change related to documentation

P1Issue that should be fixed within a few weeksIssue that should be fixed within a few weeks

serveRay Serve Related IssueRay Serve Related Issue

Status: Open.

#22719 In ray-project/ray;

· worldveil opened on Mar 1, 2022

[Feature] ray serve + model parallel deepspeed inference

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

P2Important issue, but not time-criticalImportant issue, but not time-critical

serveRay Serve Related IssueRay Serve Related Issue

Status: Open.

#22811 In ray-project/ray;

· EricSteinberger opened on Mar 3, 2022

[serve] Seeing error on terminal with serve run

enhancementRequest for new feature and/or capabilityRequest for new feature and/or capability

P2Important issue, but not time-criticalImportant issue, but not time-critical

serveRay Serve Related IssueRay Serve Related Issue

Status: Open.

#31168 In ray-project/ray;

· RAbraham opened on Dec 17, 2022

[Serve] DAG upstream dependency tracking incorrect: leads to unintended execution of nodes.

bugSomething that is supposed to be working; but isn'tSomething that is supposed to be working; but isn't

P1Issue that should be fixed within a few weeksIssue that should be fixed within a few weeks

serveRay Serve Related IssueRay Serve Related Issue

Status: Open.

#31944 In ray-project/ray;

· xeray opened on Jan 26, 2023