biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
12,946 Commits 2 Branches 140 Tags
eb28e8068dd870283f1a4fe8251ed9254d6f477e
Commit Graph

97 Commits

Author SHA1 Message Date
Isotr0py
cee7436a26 [Misc] Make scipy as optional audio/benchmark dependency (#32096) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2026-01-11 00:18:57 -08:00
TJian
7a05d2dc65 [CI] [ROCm] Fix tests/entrypoints/test_grpc_server.py on ROCm (#31970) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-01-09 12:54:20 +08:00
Chang Su
791b2fc30a [grpc] Support gRPC server entrypoint (#30190) 
Signed-off-by: Chang Su <chang.s.su@oracle.com>
Signed-off-by: njhill <nickhill123@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: njhill <nickhill123@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2026-01-07 23:24:46 -08:00
Andreas Karatzas
573dd0e6f0 [ROCm] Migrate xgrammar to upstream release (#31327) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2025-12-28 00:08:29 -08:00
Patrick von Platen
48e744976c [Mistral common] Ensure all functions are imported from the top & only use public methods (#31138) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-26 04:48:24 -08:00
shanjiaz
009a773828 bump up compressed tensors version to 0.13.0 (#30799) 
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
 2025-12-16 21:01:04 -08:00
Michael Goin
811cdf5197 Update model-hosting-container-standards to 0.1.10 (#30815) 
Signed-off-by: Michael Goin <mgoin64@gmail.com>
 2025-12-16 17:52:14 -08:00
Ye (Charlotte) Qi
e458270a95 [Misc] Add mcp to requirements (#30474) 
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
 2025-12-11 20:06:09 +00:00
avigny
dd5d1ef780 [Bugfix] Mistral tool parser streaming update (#19425) 
Signed-off-by: avigny <47987522+avigny@users.noreply.github.com>
Signed-off-by: Chauncey <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Jeff Cook <jeff@jeffcook.io>
Co-authored-by: sfbemerk <benjaminmerkel@mail.de>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-12-03 17:45:31 +00:00
HappyAmazonian
f8151b66fa Revert "Supress verbose logs from model_hosting_container_standards (… (#29335) 
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-11-28 05:29:05 -08:00
Bhagyashri
2b1b3dfa4b Update Dockerfile to use gcc-toolset-14 and fix test case failures on power (ppc64le) (#28957) 
Signed-off-by: Bhagyashri <Bhagyashri.Gaikwad2@ibm.com>
 2025-11-21 12:24:09 +00:00
cjackal
66483a9d00 [Chore] Update xgrammar version from 0.1.25 to 0.1.27 (#28221) 
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
 2025-11-20 02:53:09 -08:00
Luciano Martins
c2612371ad [Model] Add Gemma3 GGUF multimodal support (#27772) 
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-11-18 08:56:29 -08:00
Julien Denize
085424808e Remove audio optional dependency for mistral-common (#28722) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-11-14 09:54:38 -08:00
Zuyi Zhao
bca74e32b7 [Frontend] Add sagemaker_standards dynamic lora adapter and stateful session management decorators to vLLM OpenAI API server (#27892) 
Signed-off-by: Zuyi Zhao <zhaozuy@amazon.com>
Signed-off-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Shen Teng <sheteng@amazon.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2025-11-11 04:57:01 +00:00
Cole Murray
32787d0644 Remove setuptools upper bound constraint (<80) (#28337) 
Signed-off-by: Cole Murray <colemurray.cs@gmail.com>
 2025-11-08 22:30:18 +00:00
Andy Lo
5e0c1fe69c [Structured outputs] Upgrade llguidance to 1.3.0 (#28039) 
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
 2025-11-06 10:24:47 -08:00
R3hankhan
e04492449e [Hardware][IBM Z] Optimize s390x Dockerfile (#28023) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
 2025-11-05 11:25:44 -08:00
Cyrus Leung
879a06579e [CI/Build] Bump transformers version (#27528) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-31 22:11:07 -07:00
RED
c9461e05a4 Support Anthropic API /v1/messages Endpoint (#22627) 
Signed-off-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-10-22 09:13:18 -07:00
Lukas Geiger
ed344f4116 Cleanup code after Python 3.10 upgrade (#26520) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-10-16 03:38:23 -07:00
wangxiyuan
8f4b313c37 [Misc] rename torch_dtype to dtype (#26695) 
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
 2025-10-15 12:11:48 +00:00
youkaichao
8a0af6a561 [build][torch.compile] upgrade depyf version (#26702) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-10-14 10:12:09 +08:00
Sangyeon Cho
a1b2d658ee [CI/Build] upgrade compressed-tensors to 0.12.2 to address LGPLv3 (#26501) 
Signed-off-by: Sangyeon Cho <josang1204@gmail.com>
 2025-10-13 12:58:33 -04:00
Julien Denize
c6187f55f7 Refactor MistralTokenizer (#26358) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
 2025-10-09 22:48:58 +00:00
Harry Mellor
e246ad6f0c Upgrade Pydantic to v2.12.0 and remove hack for Python 3.13 (#26481) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-09 06:02:40 -07:00
Jee Jee Li
0c52d6ef81 [Bugfix] Set the minimum python version for gpt-oss (#26392) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-10-08 20:35:49 -07:00
wuhang
91ac7f764d [CI][gpt-oss] Enable python tool tests in CI (#24315) 
Signed-off-by: wuhang <wuhang6@huawei.com>
 2025-10-06 04:20:06 +00:00
Chauncey
08275ec0a2 [Build] Update Xgrammar to 0.1.25 (#25467) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-09-23 21:25:46 +00:00
Russell Bryant
486c5599e3 [Build] Update Xgrammar to 0.1.24 to get a CVE fix (#25188) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-09-19 14:27:17 +08:00
Kazuhiro Serizawa
920ed46b09 [Misc] bump outlines_core to fix the version conflicts with outlines >= 1.2.0 (#24368) 
Signed-off-by: Kazuhiro Serizawa <nserihiro@gmail.com>
Signed-off-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2025-09-09 10:59:46 -07:00
R3hankhan
e10fef0883 [Hardware][IBM Z] Fix Outlines Core issue for s390x (#24034) 
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
 2025-09-08 16:50:34 -07:00
Russell Bryant
e32a0e8678 Upgrade xgrammar to 0.1.23 (#22988) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-09-03 02:32:59 +00:00
Noam Gat
39971db3aa Frontend: Adding LM Format Enforcer support to V1 engine (#22564) 
Signed-off-by: Noam Gat <noamgat@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-08-24 19:31:22 -07:00
Martin Hickey
613a23b57f [Bugfix]: Installing dev environment due to pydantic incompatible version (#23353) 
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
 2025-08-22 16:22:29 +00:00
Kyle Sayers
c32e6ad1f6 [Quantization] Bump Compressed Tensors Version (#23202) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Dipika Sikka <dipikasikka1@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-08-20 00:39:28 +00:00
Isotr0py
d6a1a20973 [CI/Build] Update transformers to v4.55.2 (#23093) 
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
 2025-08-19 10:06:17 -07:00
Nikhil Suryawanshi
78dba404ad [Hardware][IBM Z]Enable v1 for s390x and s390x dockerfile fixes (#22725) 
Signed-off-by: Nikhil Suryawanshi <suryawanshin74@gmail.com>
 2025-08-19 04:40:37 +00:00
Breno Baldas Skuk
ac6eb49de3 fix: OpenAI SDK compat (ResponseTextConfig) (#23126) 
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
Signed-off-by: Breno Baldas Skuk <breno.skuk@hcompany.ai>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
 2025-08-18 15:22:59 -07:00
Michael Goin
bf756321c7 [CI Bugfix] Pin openai<1.100 to unblock CI (#23118) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-08-18 12:14:01 -07:00
rongfu.leng
904063907c [Misc] fix openai version (#22485) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-08-08 01:12:54 -07:00
Harry Mellor
ecbea55ca2 Update hf_xet pin to resolve hangs (#22356) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-08-06 20:31:41 -07:00
Woosuk Kwon
134a8ee8fd [gpt-oss] Add openai-harmony as default dependency (#22332) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
 2025-08-06 00:10:14 -07:00
Harry Mellor
796bae07c5 Update transformers to v4.55 (#21931) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-05 22:56:14 -07:00
Woosuk Kwon
dd16bdc798 Increase openai-python version (#22316) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-05 21:43:21 -07:00
Woosuk Kwon
0f81b310db [Misc] Remove upper bound in openai package version (#22060) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-08-01 02:11:40 -07:00
Chauncey
6da0078523 [Feat] Allow custom naming of vLLM processes (#21445) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-24 03:15:23 -07:00
Julien Denize
6d8d0a24c0 Add think chunk (#21333)
Some checks failed
Create Release / Create Release (push) Has been cancelled
Details 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
 2025-07-23 21:51:32 -07:00
Chauncey
b5c3b68359 [Misc] bump xgrammar version to v0.1.21 (#20992) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-07-15 19:42:16 -07:00
Patrick von Platen
e7e3e6d263 Voxtral (#20970) 
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-07-15 07:35:30 -07:00