Skip to content

feat: add per-request context to the /v1/messages loop (#137) - #249

Open
Zheng-Lu wants to merge 1 commit into
vllm-project:mainfrom
Zheng-Lu:feat/messages-request-context
Open

feat: add per-request context to the /v1/messages loop (#137)#249
Zheng-Lu wants to merge 1 commit into
vllm-project:mainfrom
Zheng-Lu:feat/messages-request-context