biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
13,302 Commits 2 Branches 140 Tags
57eae2f8918b42fc0fd3ed0b440b4eef6eae42e9
Commit Graph

133 Commits

Author SHA1 Message Date
TJian
f176443446 [Release] [CI] Optim release pipeline (#33156) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
(cherry picked from commit f9d03599ef)
 2026-01-28 22:47:10 -08:00
Wentao Ye
7ef5873752 [CI] Fix mypy for vllm/v1/structured_output (#32722) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-01-23 11:55:51 +08:00
Lucas Kabela
15e302dfce [Misc][BE] Turn on strict type coverage for vllm/compilation (#31756) 
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
 2026-01-22 15:12:26 +00:00
Cyrus Leung
d117a4d1a9 [Frontend] Introduce Renderer for processing chat messages (using ModelConfig) (#30200) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-22 12:44:22 +00:00
Robert Shaw
42135d6898 [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) 2026-01-21 08:22:33 -05:00
dolpm
7c5dedc247 [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) 
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
 2026-01-20 19:45:59 +00:00
Mritunjay Kumar Sharma
9e078d0582 [CI/Build][Docker] Add centralized version manifest for Docker builds (#31492) 
Signed-off-by: Mritunjay Sharma <mritunjay.sharma@chainguard.dev>
 2026-01-17 13:45:30 +00:00
Wentao Ye
9fd918e510 [CI] Update deepgemm to newer version (#32479) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-01-17 01:18:05 +08:00
TJian
41c544f78a [ROCm] [CI] [Release] Rocm wheel pipeline with sccache (#32264) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-01-16 02:56:18 +08:00
Cyrus Leung
28459785ff [3/N] Group together media-related code (#32406) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-15 11:52:12 +00:00
Matthew Bonanni
0308901975 [2/N][Attention] Fix pre-commit errors (#32052) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-01-10 00:27:15 +00:00
Matthew Bonanni
2612ba9285 [1/N][Attention] Restructure attention: move files (#31916) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-01-09 13:10:24 -08:00
Jack Yang
0a2c2dc3f1 fixed mypy warnings for files vllm/v1/attention with TEMPORARY workaround (#31465) 
Signed-off-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
 2026-01-07 04:08:47 +00:00
Nikhil G
ada6f91d56 Fix RecursionError in MediaWithBytes unpickling (#31191) 
Signed-off-by: Nikhil Ghosh <nikhil@anyscale.com>
 2026-01-06 20:11:26 +00:00
Seiji Eicher
3c98c2d21b [CI/Build] Allow user to configure NVSHMEM version via ENV or command line (#30732) 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2026-01-05 15:56:08 -08:00
Roberto L. Castro
fdcc5176be [BugFix] Fix architecture flags to prevent issues on SM103 (#31150) 
Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
 2026-01-05 20:11:35 +00:00
Andreas Karatzas
f70368867e [ROCm][CI] Add TorchCodec source build for transcription tests (#31323) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2025-12-28 16:06:05 +08:00
Wentao Ye
02a5880394 [CI] Fix mypy for vllm/v1/executor (#30517) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-12-12 18:05:34 +00:00
Seiji Eicher
b9e0951f96 [docs] Improve wide-EP performance + benchmarking documentation (#27933) 
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
 2025-12-10 22:15:54 +00:00
Dmitry Tokarev
799804d140 Bump nvshmem to 3.3.24 and fix CUDA 13 installation (#30149) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-08 20:24:34 +00:00
Cyrus Leung
2afcec4dec [Misc] Update TokenizerLike interface and move get_cached_tokenizer (#29730) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-11-30 14:59:47 +08:00
Cyrus Leung
34a984274e [Misc] Refactor tokenizer interface (#29693) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-11-29 04:02:21 -08:00
Cyrus Leung
9e6bcda3ac [mypy] Enable type checking for more directories (#29674) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-11-28 08:39:27 -08:00
Cyrus Leung
953d9c820b [mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-11-28 20:40:47 +08:00
Alec
c4c0354eec [CI/Build] allow user modify pplx and deepep ref by ENV or command line (#29131) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
 2025-11-26 17:41:16 +00:00
Qidong Su
4587063267 Patch DeepEP when building docker image with CUDA 13 (#29154) 
Signed-off-by: Qidong Su <soodoshll@gmail.com>
 2025-11-22 23:25:13 +00:00
Benjamin Bartels
eb5352a770 [CI/build] Removes source compilation from runtime image (#26966) 
Signed-off-by: bbartels <benjamin@bartels.dev>
 2025-11-22 10:23:09 -08:00
Wentao Ye
56669c1f29 [CI] Fix mypy for vllm/v1/worker (#29037) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-11-21 11:36:07 +08:00
Chendi.Xue
c3e2978620 [NIXL] fix cpu PD after physical <> logical block_size PR (#28904) 
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
 2025-11-18 14:03:23 -05:00
liuzhenwei
d64429bb36 [NIXL][XPU] update install script of NIXL (#28778) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2025-11-17 03:01:33 +00:00
Johnny Yang
fdfd5075aa [TPU] patch TPU wheel build script to resolve metadata issue (#27279) 
Signed-off-by: Johnny Yang <johnnyyang@google.com>
 2025-11-13 09:36:54 -08:00
liuzhenwei
14a125a06d [NIXL][XPU] Pin NIXL version to 0.7.0 (#27849) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2025-11-04 03:28:35 +00:00
Matthew Bonanni
d5d2a0fe74 [Misc] Make all tool scripts executable (#27831) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2025-10-30 23:46:02 +00:00
Wentao Ye
c01f6e525f [CI] Fix mypy for vllm/v1/core and vllm/v1/engine (#27108) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-10-30 11:32:17 +00:00
Cyrus Leung
ecca3fee76 [Frontend] Add vllm bench sweep to CLI (#27639) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-29 05:59:48 -07:00
Cyrus Leung
4fb8771cc0 [CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-29 08:04:33 +00:00
liuzhenwei
d2c33c397a [NIXL][XPU] update name of nixl wheel (#27631) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2025-10-29 12:43:29 +08:00
Cyrus Leung
6ebffafbb6 [Misc] Clean up more utils (#27567) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-27 15:30:38 +00:00
Huy Do
becb7de40b Update PyTorch to 2.9.0+cu129 (#24994) 
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-10-21 17:20:18 -04:00
Nick Hill
647214f3d5 [V0 Deprecation] Remove V0 executors (#27142) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-10-21 11:09:37 -07:00
Cyrus Leung
d31f7844f8 [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-19 05:20:55 -07:00
dongbo910220
8a297115e2 [Chore] Separate out hashing utilities from vllm.utils (#27151) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2025-10-19 11:09:38 +08:00
Varun Sundar Rabindranath
30a33b92ee [Misc] Rev DeepEP (#27122) 
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
 2025-10-18 14:54:29 +08:00
Harry Mellor
6c9fdbf725 [Docs] Replace rst style double-backtick with md single-backtick (#27091) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-17 02:47:34 -07:00
Wentao Ye
71557a5f7c [CI] Fix mypy for vllm/executor (#26845) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2025-10-15 01:23:33 -07:00
Wentao Ye
314285d4f2 [CI] Fix mypy for vllm/distributed (#26593) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-13 16:02:24 -04:00
Michael Goin
7ef6052804 [CI/Build] Add tool to build vllm-tpu wheel (#19165) 
Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-10-12 16:25:40 -06:00
Harry Mellor
8fcaaf6a16 Update Optional[x] -> x | None and Union[x, y] to x | y (#26633) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-12 09:51:31 -07:00
liuzhenwei
27ed39a347 [XPU] Upgrade NIXL to remove CUDA dependency (#26570) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
 2025-10-11 05:15:23 +00:00
Zhengxu Chen
eef921f45e AOT Compilation for torch.compile (Bundled) (#24274) 
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
 2025-10-10 19:02:11 -04:00