Pinned Loading

1. python/cpython python/cpython Public

   The Python programming language

   Python 76k 35.4k

2. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 103k 29.1k

3. NVIDIA/Megatron-LM NVIDIA/Megatron-LM Public

   Ongoing research training transformer models at scale

   Python 17.8k 4.5k

4. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 14.6k 2.7k

5. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 35.5k 8.6k

6. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

   FlashInfer: Kernel Library for LLM Serving

   Cuda 6.3k 1.4k