Skip to content

Improve process creation#1534

Merged
merrymercy merged 12 commits intomainfrom
mem-pool
Sep 29, 2024
Merged

Improve process creation#1534
merrymercy merged 12 commits intomainfrom
mem-pool

Conversation

@merrymercy
Copy link
Copy Markdown
Contributor

@merrymercy merrymercy commented Sep 29, 2024

  • Simplify the process creation process
  • Rename controller to scheduler
  • Use LimitedCapacityDict in DetokenizerManager
  • Temporarily disable data parallelism

@merrymercy merrymercy changed the title Refactor process creation Improve process creation Sep 29, 2024
@merrymercy merrymercy merged commit 0486854 into main Sep 29, 2024
@merrymercy merrymercy deleted the mem-pool branch September 29, 2024 09:36
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant