mlx-serve

Here is 1 public repository matching this topic...

A heads-up display with per-turn/session telemetry for both local engine and cloud models. Data straight from the engine. Look for it in the sidebar.

opencode tui hud mlx inference-engine ttft llama-cpp vllm koboldcpp sglang opencode-plugin mtplx opencode2 tokens-per-secon mlx-serve

To associate your repository with the mlx-serve topic, visit your repo's landing page and select "manage topics."