biondizzle/vllm-to-sglang
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Commit Graph

  • 7d9c4da2ee not sure why we have a default tool parser master biondizzle 2026-04-13 17:49:44 +00:00
  • efc9dc33e7 dynamic arg translation, remove entrypoint.sh, update README biondizzle 2026-04-12 21:23:26 +00:00
  • 7c1ed0408b fix: recursive _fix_schema to handle nested properties=[] at any depth biondizzle 2026-04-12 20:52:44 +00:00
  • a9911386e0 strip guided_json, guided_regex too; fix parameters.properties array biondizzle 2026-04-12 20:27:44 +00:00
  • ccedd3ecee fix: add chat_template_kwargs to STRIP_PARAMS, fix parameters.properties array biondizzle 2026-04-12 20:23:10 +00:00
  • c66511e16f fix: handle parameters.properties being array, not just parameters itself biondizzle 2026-04-12 20:17:06 +00:00
  • e03e41eb4f fix vLLM/SGLang schema mismatc biondizzle 2026-04-12 19:57:47 +00:00
  • 7ecbac2dc0 Fix UnboundLocalError in health(), switch from on_event to lifespan biondizzle 2026-04-12 19:41:08 +00:00
  • 774964a4db Add error dump logging: capture full request+response on 4xx/5xx from SGLang biondizzle 2026-04-12 19:28:04 +00:00
  • db9231f796 Fix middleware: handle SGLang startup lag gracefully biondizzle 2026-04-12 19:06:38 +00:00
  • bbe40ac8c0 Add middleware to strip vLLM-only params (logprobs/top_logprobs) before forwarding to SGLang biondizzle 2026-04-12 18:58:37 +00:00
  • 359aa94337 Update README: haproxy proxy layer, /health probe fix, current state metrics biondizzle 2026-04-12 18:27:06 +00:00
  • 6476c9c12a fix: content-length 16 not 15, remove 'timeout check' (not valid in haproxy 2.4 server line) biondizzle 2026-04-12 17:29:08 +00:00
  • 725e61d792 fix: haproxy 2.4 compat — use errorfile instead of http-request return biondizzle 2026-04-12 17:26:45 +00:00
  • 1ddc08c88b haproxy: intercept /health too — instant response based on backend state biondizzle 2026-04-12 17:21:04 +00:00
  • 7fb373fdfc Add haproxy proxy: /metrics returns 200 empty, everything else proxies to SGLang biondizzle 2026-04-12 17:09:58 +00:00
  • dd3a981497 Log all received args to /tmp/vllm-shim.log biondizzle 2026-04-12 04:37:24 +00:00
  • 513f8bb5dd we dont need to compile aiter biondizzle 2026-04-12 04:16:50 +00:00
  • 2ac7778c15 Rewrite README: explain the shim, current state, and how to adapt for other models biondizzle 2026-04-12 03:07:43 +00:00
  • 71f7fe0881 fix aiter biondizzle 2026-04-12 02:56:27 +00:00
  • b6151ba5db fix aiter biondizzle 2026-04-12 02:47:33 +00:00
  • 4d444bebbb use a shim biondizzle 2026-04-12 02:19:55 +00:00
  • c86fbe0166 Fix Jenkinsfile: agent any, nightly default, proper quoting biondizzle 2026-04-12 00:22:29 +00:00
  • d71248d0f6 init commit biondizzle 2026-04-11 23:39:36 +00:00