7 lines
239 B
Markdown
7 lines
239 B
Markdown
# vLLM to SGLang
|
|
|
|
vLLM production stack is great, but some things just work out of the box on sglang.
|
|
|
|
this just kind of just proxies the bootstrapping of a model deployment in vllm stack to sglang
|
|
|
|
this is a PoC im trying out right now. |