Pinned Loading

1. Solutions-for-tensara Solutions-for-tensara Public

   My solution for tensara.

   Python 2

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 27.6k 5.8k

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 79.6k 16.6k

4. novitalabs/pegaflow novitalabs/pegaflow Public

   High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and SGLang.

   Rust 60 10