Skip to content

[Tracker] Blackwell support #5338

@zhyncs

Description

@zhyncs

Usage

docker pull lmsysorg/sglang:blackwell

# use latest main
cd /sgl-workspace/sglang && git pull

Models

DeepSeek V3 ✅

python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3 --tp 8 --trust-remote-code

Llama 4 ✅

python3 -m sglang.launch_server --model meta-llama/Llama-4-Scout-17B-16E-Instruct --tp 8 --context-length 131072

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions