Thank you for your contribution, we really appreciate it. The following instructions will help improve your pull request and make it easier to receive feedback. If there are any items you don't understand, don't worry. Just submit the pull request and ask the maintainers for help.

Motivation

Use dtype to control generate type. Dispatch to regex in RuntimeEndpoint.

Modification

1. Remove the int_token_logit_bias
2. Support dtype in ["int", "str", "float", "bool", int, str, float, bool]
3. For int and float dtype decoding, add tailing [ \n]* and add these two as stop str.

Checklist

1. Ensure pre-commit pre-commit run --all-files or other linting tools are used to fix potential lint issues.
2. Confirm that modifications are covered by complete unit tests. If not, please add more unit tests for correctness.
3. Modify documentation as needed, such as docstrings or example tutorials.