Skip to content

feat(serve): adaptive decode/prefill pacing by default : incoming prompts no longer freeze in-flight replies - #40

Merged
asher merged 11 commits into
mainfrom
decode-prefill-auto
Aug 10, 2026
Merged

feat(serve): adaptive decode/prefill pacing by default : incoming prompts no longer freeze in-flight replies#40
asher merged 11 commits into
mainfrom
decode-prefill-auto

changelog: tighten auto default bullet

8e0ead8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
lint
succeeded Aug 10, 2026 in 10s