biondizzle/vllm-to-sglang
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2 Commits 2 Branches 0 Tags
c86fbe0166e2484a06f415cd95cf82b6cb2cff97
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

vLLM to SGLang

vLLM production stack is great, but some things just work out of the box on sglang.

this just kind of just proxies the bootstrapping of a model deployment in vllm stack to sglang

this is a PoC im trying out right now.

Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
Readme 107 KiB
Languages
Python 70.6%
Shell 23.3%
Dockerfile 6.1%