Skip to content

set CUDA_DEVICE_MAX_CONNECTIONS=1#1113

Merged
zhyncs merged 1 commit intomainfrom
deadlock-2
Aug 15, 2024
Merged

set CUDA_DEVICE_MAX_CONNECTIONS=1#1113
zhyncs merged 1 commit intomainfrom
deadlock-2

Conversation

@merrymercy
Copy link
Copy Markdown
Contributor

This can reduce the chance of deadlock in multi nodes

@merrymercy merrymercy marked this pull request as ready for review August 15, 2024 17:45
@zhyncs zhyncs merged commit 0cb099e into main Aug 15, 2024
@zhyncs zhyncs deleted the deadlock-2 branch August 15, 2024 17:47
hnyls2002 pushed a commit to yichuan-w/sglang that referenced this pull request Aug 16, 2024
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants