llm-queue-proxy

FIFO admission proxy for local LLM servers: one in-flight generation, queue the rest.