Skip to content

An an example for multi-host inference with Service #61

@kerthcet

Description

@kerthcet

What would you like to be added:

Right now we don't support multi-host in playground, but this is supported in Service, we should provide an example.

Why is this needed:

Completion requirements:

This enhancement requires the following artifacts:

  • Design doc
  • API change
  • Docs update

The artifacts should be linked in subsequent comments.

Metadata

Metadata

Assignees

No one assigned

    Labels

    cleanupCategorizes issue or PR as related to cleaning up code, process, or technical debt.needs-priorityIndicates a PR lacks a label and requires one.needs-triageIndicates an issue or PR lacks a label and requires one.

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions