Skip to content

[Serve][Doc] Add FAQ Page#11258

Merged
simon-mo merged 4 commits intoray-project:masterfrom
simon-mo:serve/doc-faq
Oct 20, 2020
Merged

[Serve][Doc] Add FAQ Page#11258
simon-mo merged 4 commits intoray-project:masterfrom
simon-mo:serve/doc-faq

Conversation

@simon-mo
Copy link
Copy Markdown
Contributor

@simon-mo simon-mo commented Oct 7, 2020

Move some FAQ page and add more content from feedback at Ray Summit.

Why are these changes needed?

Closes #10322

Related issue number

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

Move some FAQ page and add more content from feedback at Ray Summit.

In this case, Serve will `not` wrap it in ServeRequest. You can directly
process the request as a ``flask.Request``.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New content starts here

Copy link
Copy Markdown
Collaborator

@edoakes edoakes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great! Thanks for doing this. Just left some wording suggestions.

How fast is ray serve?
----------------------
We are continuously benchmark Ray Serve. We can confidently say Ray Serve's
overhead is single digit millisecond, often times just 1-2 milliseconds. So
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
overhead is single digit millisecond, often times just 1-2 milliseconds. So
overhead is single digit milliseconds, often times just 1-2 milliseconds. So

@simon-mo simon-mo merged commit 1bce751 into ray-project:master Oct 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[serve] add "Ray Serve vs TorchServe vs TFX Serving vs Multi Model Server" to FAQ

3 participants