Skip to content

[serve] Make controller use import paths #22604

@shrekris-anyscale

Description

@shrekris-anyscale

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

The Serve controller primarily uses serialized classes and functions when setting up replicas. It should instead primarily use import paths.

Use case

Import paths better support the REST API and cross-language use cases. With runtime environments, replicas can directly import the deployment class or function without worrying about serialization.

Related issues

#22578 contains some discussion about this enhancement.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issue, but not time-criticalenhancementRequest for new feature and/or capabilityserveRay Serve Related Issue

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions