biondizzle/vllm-to-sglang
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5 Commits 2 Branches 0 Tags
71f7fe0881b2be425eb28be87ede60a3f6cb3ffa
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
biondizzle 71f7fe0881 fix aiter
2026-04-12 02:56:27 +00:00
Dockerfile
fix aiter
2026-04-12 02:56:27 +00:00
entrypoint.sh
init commit
2026-04-11 23:39:36 +00:00
Jenkinsfile
Fix Jenkinsfile: agent any, nightly default, proper quoting
2026-04-12 00:22:29 +00:00
README.md
Fix Jenkinsfile: agent any, nightly default, proper quoting
2026-04-12 00:22:29 +00:00
vllm_shim_module.py
use a shim
2026-04-12 02:19:55 +00:00
vllm-shim.sh
use a shim
2026-04-12 02:19:55 +00:00

README.md

vLLM to SGLang

vLLM production stack is great, but some things just work out of the box on sglang.

this just kind of just proxies the bootstrapping of a model deployment in vllm stack to sglang

this is a PoC im trying out right now.

Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
Readme 107 KiB
Languages
Python 70.6%
Shell 23.3%
Dockerfile 6.1%