pytorch-optimization

A lightweight quantization module for PyTorch models

Standalone AMD ROCm/PyTorch tools for pruning, expanding, and continued-pretraining an LLM checkpoint on a single MI300X GPU

Collection of Triton operators for transformer models.

A high-level course on High-Performance Computing (HPC) and the systems engineering required to train, fine-tune, and serve Large Language Models (LLMs) efficiently.