freetoken

Here are 3 public repositories matching this topic...

47thtechcorner / RayCodes_FreeToken

I Ran Qwen 3.8 27B on Just 4GB VRAM! (FreeToken Tutorial) - Edge-native MoE serving engine for local LLMs on low VRAM GPUs

python moe vram edge-ai llm local-ai qwen freetoken

Updated Aug 23, 2026
Python

chengyixu / freetoken-macos-deployment

Star

Reproducible Apple-Silicon (Apple MLX) deployment and one-token verification kit for the FreeToken edge-native MoE serving API — pinned, loopback-only, schema-validated evidence.

macos benchmark reproducibility mlx mixture-of-experts research-reproducibility apple-silicon inference-serving llm-inference freetoken

Updated Aug 23, 2026
Python

trev222 / pocketai-freetoken-sm75

Star

Reproducible FreeToken MoE expert-offload compatibility lab and benchmarks for NVIDIA Turing sm_75.

cuda mixture-of-experts pocketai llama-cpp qwen sm75 freetoken nvidia-turing

Updated Aug 24, 2026
Python

Improve this page

Add a description, image, and links to the freetoken topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the freetoken topic, visit your repo's landing page and select "manage topics."

Learn more