biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
15,650 Commits 2 Branches 140 Tags
adaabb8a55b3109babaaee7e2821ceefe05d6db4
Commit Graph

125 Commits

Author SHA1 Message Date
Rishi Puri
adaabb8a55 Add nightly b200 test for spec decode eagle correctness (#38577) 
Signed-off-by: Rishi Puri <riship@nvidia.com>
 2026-04-09 20:09:09 +00:00
Cyrus Leung
3b1d9c3156 [CI/Build] Fix memory cleanup in MM test (#39411) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-04-09 08:50:45 -07:00
Roberto L. Castro
b55d830ec7 [Perf][Kernel] Persistent TopK scheduler: unified CUDAGraph-safe kernel with dynamic per-row dispatch - DeepSeek-V3.2 DSA decode (#37421) 
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
 2026-04-08 13:35:57 -04:00
Andrey Talman
2111997f96 [release 2.11] Update to torch 2.11 (#34644) 2026-04-07 18:55:48 -07:00
Flora Feng
5af684c319 [CI] Add reasoning parser tests to CI (#37025) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-04-08 00:57:36 +00:00
Giancarlo Delfin
5daf62271d [Model Runner V2] Fuse probabilistic rejection sample kernels (#38496) 
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
 2026-04-07 17:37:37 -07:00
bnellnm
f01482408c [MoE Refactor][Test] FusedMoE layer test (#24675) 
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
 2026-04-06 17:17:23 +00:00
Kevin H. Luu
56de443db1 [ci] Switch some CI jobs to H200 MIG slices (#38956) 2026-04-05 13:26:11 -07:00
Jeffrey Wang
ab79863e6c Remove MQ multi-node tests (#38934) 
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
 2026-04-03 20:00:08 +00:00
Nick Hill
5f1de2b14b [Model Runner V2] Add config validation for not-yet-supported features (#38758) 
Signed-off-by: Nick Hill <nickhill123@gmail.com>
 2026-04-03 12:08:08 -07:00
Varun Sundar Rabindranath
2ad7c0335f [Model] Add Phi4ForCausalLMV for microsoft/Phi-4-reasoning-vision-15B (#38306) 
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
 2026-04-02 21:14:57 -07:00
Carl Y
1f5ec2889c [mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) 
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-02 21:16:11 -04:00
Stefano Castagnetta
188defbd0b [CI] Add flashinfer.py to attention test source deps (#38792) 
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2026-04-02 19:24:29 +00:00
Yanan Cao
ecd5443dbc Bump helion dependency from 0.3.2 to 0.3.3 (#38062) 
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-02 10:59:33 -07:00
Jeffrey Wang
de5e6c44c6 [Feat][Executor] Introduce RayExecutorV2 (#36836) 
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
 2026-04-01 14:34:29 -07:00
Luka Govedič
40bb175027 [vLLM IR] 1/N Implement IR skeleton and rms_norm op (#33825) 
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>
 2026-03-31 22:15:05 -04:00
Ilya Markov
abdbb68386 [EPLB] Add alternative communication for EPLB weight exchange (#33176) 
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
Co-authored-by: Markov Ilya <markovilya19@gmail.com>
 2026-03-31 08:17:12 -04:00
Kevin H. Luu
42318c840b [ci] Remove benchmarks job (#38611) 2026-03-31 06:46:21 +00:00
Kyle Sayers
d28d86e8a3 [QeRL] Fix online quantized reloading (#38442) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2026-03-29 14:56:41 -06:00
Sage Moore
497e234d38 [EPLB] Cleanup the transfer logic for the various eplb maps (#34520) 
Signed-off-by: Sage Moore <sagmoore@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
 2026-03-27 10:18:46 +01:00
Giancarlo Delfin
c32e97602d [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) 
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
 2026-03-26 13:38:12 -07:00
Wentao Ye
e054f152fa [CI] Add batch invariant test for b200 (#38014) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-03-26 11:54:54 -04:00
Richard Zou
6e37c46b35 [compile] Add some more startup tests for top models (#38046) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-03-25 12:02:22 -04:00
Kevin H. Luu
b2dd75eb48 Downsize CPU jobs to use small queue (#37913) 
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
 2026-03-23 20:36:37 -07:00
Wentao Ye
83c9d525b6 [CI] Add batch invariant test: Block FP8 + small MOE (#37895) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-03-23 21:16:14 -04:00
roikoren755
56777b5c89 [Test] E2E Nemotron-3-Super tests (#36803) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2026-03-23 17:49:56 -07:00
Kevin H. Luu
2488a82f89 [CI] Split V1 Others into 3 separate jobs (#37016) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-24 06:44:38 +08:00
Kunshang Ji
91fd695b75 [CI] split Entrypoints Integration (API Server 1) into 3 jobs (#37882) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-03-23 10:37:56 -07:00
Nicolò Lucchesi
1cbbcfe8a3 [CI][PD] Add Hybrid SSM integration tests to CI (#37657) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-23 23:58:19 +08:00
Jee Jee Li
1f0d210641 [CI/Build][LoRA] Update Qwen35 LoRA testing (#37816) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-23 12:55:49 +08:00
Woosuk Kwon
43877a620b [MRV2] Enable PP CUDA graph test (#37830) 
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
 2026-03-22 16:30:25 -07:00
Vadim Gimpelson
4f16ebbbd3 [Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605) 
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
 2026-03-20 12:19:26 -07:00
Lucas Wilkinson
e1d85e5c24 [Attention] Support distinguishing between short extends and decodes (#37303) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-03-20 10:49:36 -07:00
Flora Feng
b4c1aef21c [Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 02:50:34 -07:00
Flora Feng
6050b93bed [Refactor] Move serve entrypoint tests under tests/entrypoints/serve/ (#37595) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 02:10:47 -07:00
Andreas Karatzas
bd8c4c0752 [CI] Removing deprecated rlhf examples reference (#37585) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-20 15:20:33 +08:00
Jee Jee Li
8fbe3f303f [Bugfix][LoRA] Fix Qwen35 LoRA (#36976) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-20 11:09:32 +08:00
Andreas Karatzas
040a505ff5 [ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-19 14:30:58 -05:00
Cyrus Leung
c7bc12c20f [CI/Build] Split out MM pooling tests (#37542) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-19 11:36:11 +00:00
TJian
da70c87e81 [CI] Fix wrong path test file, missing rlhf_async_new_apis.py (#37532) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-03-19 02:21:55 -07:00
Itay Alroy
de1a86b7de elastic_ep: Fix stateless group port races (#36330) 
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
 2026-03-18 14:36:18 +00:00
Aaron Hao
47a1f11bff [docs] Add docs for new RL flows (#36188) 
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-18 09:04:26 +00:00
Avinash Singh
c5030c439d [CI] Split Distributed Tests (4 GPUs) and Kernel MoE tests (#37100) 
Signed-off-by: Avinash Singh <avinashsingh.rcoem@gmail.com>
Signed-off-by: Avinash Singh  <107198269+avinashsingh77@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-03-17 11:44:55 -07:00
Richard Zou
979ff44cea [BugFix] PyTorch Compilation Tests should error if any test fails (#37300) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-03-17 15:26:38 +00:00
Flora Feng
384dc7f77b [Refactor] Relocate completion and chat completion tests (#37125) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-17 11:31:23 +08:00
Kevin H. Luu
600a039f57 [CI] Shard Multi-Modal Models (Standard) into 4 parallel jobs (#37014) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-14 08:26:54 +00:00
Kevin H. Luu
74fe80ee95 [CI] Split Distributed Tests (4 GPUs) into 3 parallel jobs (#37015) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-14 12:21:13 +08:00
Flora Feng
bcfdadb1bc [Refactor] Relocate chat completion and anthropic tests (#36919) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-14 12:16:16 +08:00
Kevin H. Luu
f1816fb192 [CI] Split V1 e2e + engine (1 GPU) into separate jobs (#36945) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-13 14:16:02 -07:00
Aaron Hao
d6b61e5166 [BUG] Fix async rlhf tests (#35811) 
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
 2026-03-11 18:06:10 -04:00