-
Notifications
You must be signed in to change notification settings - Fork 7.4k
[serve] Make controller use import paths #22604
Copy link
Copy link
Closed
Labels
P2Important issue, but not time-criticalImportant issue, but not time-criticalenhancementRequest for new feature and/or capabilityRequest for new feature and/or capabilityserveRay Serve Related IssueRay Serve Related Issue
Milestone
Description
Search before asking
- I had searched in the issues and found no similar feature requirement.
Description
The Serve controller primarily uses serialized classes and functions when setting up replicas. It should instead primarily use import paths.
Use case
Import paths better support the REST API and cross-language use cases. With runtime environments, replicas can directly import the deployment class or function without worrying about serialization.
Related issues
#22578 contains some discussion about this enhancement.
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
P2Important issue, but not time-criticalImportant issue, but not time-criticalenhancementRequest for new feature and/or capabilityRequest for new feature and/or capabilityserveRay Serve Related IssueRay Serve Related Issue