Usage
docker pull lmsysorg/sglang:blackwell
# use latest main
cd /sgl-workspace/sglang && git pull
Models
DeepSeek V3 ✅
python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3 --tp 8 --trust-remote-code
Llama 4 ✅
python3 -m sglang.launch_server --model meta-llama/Llama-4-Scout-17B-16E-Instruct --tp 8 --context-length 131072
Usage
Models
DeepSeek V3 ✅
Llama 4 ✅