Pinned Loading

1. llumnix-project/llumnix-ray llumnix-project/llumnix-ray Public

   Efficient and easy multi-instance LLM serving

   Python 547 49

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 27.6k 5.8k

3. vllm-project/vllm-omni vllm-project/vllm-omni Public

   A framework for efficient model inference with omni-modality models

   Python 4.7k 898

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 79.5k 16.6k