Skip to content
#

multi-turboquant

Star

Here are 2 public repositories matching this topic...

aivrar / vllm-windows-build

Sponsor
Star 36

Native Windows vLLM 0.26.0: CPython 3.13, CUDA 12.8, SM 7.5/8.6/8.9/12.0 for RTX 20/30/40/50, OpenAI-compatible serving, Triton/FlashAttention, 10 KV-cache formats, Multi-TurboQuant, and experimental CPU/RAM/NVMe prompt-KV offload. No WSL or Docker.

windows gpu cuda pytorch nvidia triton msvc quantization kv-cache awq llm llm-serving vllm llm-inference flash-attention qwen kv-cache-compression turboquant vllm-windows multi-turboquant
  • Updated Aug 1, 2026
  • Python

Improve this page

Add a description, image, and links to the multi-turboquant topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multi-turboquant topic, visit your repo's landing page and select "manage topics."

Learn more