Pinned Loading

1. hao-ai-lab/DistCA hao-ai-lab/DistCA Public

   Efficient Long-context Language Model Training by Core Attention Disaggregation

   Python 97 7

2. nsys-ai nsys-ai Public

   Terminal UI for NVIDIA Nsight Systems profiles — timeline viewer, kernel navigator, NVTX hierarchy

   Python 45 8

3. LLMServe/DistServe LLMServe/DistServe Public

   Disaggregated serving system for Large Language Models (LLMs).

   Jupyter Notebook 790 87

4. hao-ai-lab/Dynasor hao-ai-lab/Dynasor Public

   [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.

   Python 224 29

5. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 74.1k 14.7k