biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
15,215 Commits 2 Branches 140 Tags
09c3dc91862eb3770c2456f570e95ebc81161b7d
Commit Graph

1167 Commits

Author SHA1 Message Date
Andreas Karatzas
679c6a3ecc [Bugfix][ROCm][MoE] Fix mxfp4 oracle regressions from #37128 (#37787) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-25 08:17:33 +08:00
Andreas Karatzas
8bbb7c7f20 [ROCm][CI][PD] Add Hybrid SSM integration tests to CI (#37924) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-25 07:58:39 +08:00
Kevin H. Luu
af945615b5 [release] Move the rest of release jobs to release queue (#38044) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-03-24 16:40:58 -07:00
amey asgaonkar
0c1809c806 Add Ubuntu 24.04 support for Docker builds (#35386) 
Signed-off-by: aasgaonkar <aasgaonkar@nvidia.com>
 2026-03-24 13:34:44 -07:00
Li, Jiang
352b90c4a4 [Bugfix] Add replacement of _compute_slot_mapping_kernel on CPU (#37987) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2026-03-24 07:00:20 -07:00
Kevin H. Luu
7281199a8c [release] Move agent queue to Release cluster queues (#37783) 
Signed-off-by: khluu <khluu000@gmail.com>
 2026-03-23 20:36:47 -07:00
Kevin H. Luu
b2dd75eb48 Downsize CPU jobs to use small queue (#37913) 
Signed-off-by: khluu <khluu000@gmail.com>
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
 2026-03-23 20:36:37 -07:00
Andreas Karatzas
de99d91ece [ROCm][CI] Split Entrypoints Integration (API Server 1) into 3 jobs (#37906) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-24 09:48:37 +08:00
Wentao Ye
83c9d525b6 [CI] Add batch invariant test: Block FP8 + small MOE (#37895) 
Signed-off-by: yewentao256 <zhyanwentao@126.com>
 2026-03-23 21:16:14 -04:00
roikoren755
56777b5c89 [Test] E2E Nemotron-3-Super tests (#36803) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2026-03-23 17:49:56 -07:00
Kevin H. Luu
2488a82f89 [CI] Split V1 Others into 3 separate jobs (#37016) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-24 06:44:38 +08:00
Kyle Sayers
38364a7e32 [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2026-03-23 16:03:29 -04:00
Kunshang Ji
91fd695b75 [CI] split Entrypoints Integration (API Server 1) into 3 jobs (#37882) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-03-23 10:37:56 -07:00
Nicolò Lucchesi
1cbbcfe8a3 [CI][PD] Add Hybrid SSM integration tests to CI (#37657) 
Signed-off-by: NickLucche <nlucches@redhat.com>
 2026-03-23 23:58:19 +08:00
Jee Jee Li
1f0d210641 [CI/Build][LoRA] Update Qwen35 LoRA testing (#37816) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-23 12:55:49 +08:00
Woosuk Kwon
43877a620b [MRV2] Enable PP CUDA graph test (#37830) 
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
 2026-03-22 16:30:25 -07:00
Andreas Karatzas
6eedec6e36 [ROCm][CI] Make some duplicated tests optional so that they are only evaluated in our nightly (#37780) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-22 16:03:18 +08:00
Andreas Karatzas
e78bc74268 [ROCm][CI] close missing quote in kernels/moe block in run-amd-test.sh (#37774) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-22 09:42:34 +08:00
Robert Shaw
eeee5b262d [Quantization][Deprecation] Remove PTPC FP8 (#32700) 
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
 2026-03-21 22:10:16 +00:00
Andreas Karatzas
02eec7ecbe [ROCm][CI] Update GSM8K eval config to use fp8-and-mixed models list (MI355) (#37721) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-21 15:27:12 +08:00
Andreas Karatzas
0d50fa1db6 [ROCm][CI] Mark gemma3 as large GPU test to avoid OOM on MI250 (#37610) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-21 12:57:25 +08:00
Andreas Karatzas
8bc6b5cdb0 [ROCm][CI] Setting some mi325_4 tests back to optional (in parity with upstream) (#37711) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-20 12:25:08 -07:00
Vadim Gimpelson
4f16ebbbd3 [Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605) 
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
 2026-03-20 12:19:26 -07:00
Lucas Wilkinson
e1d85e5c24 [Attention] Support distinguishing between short extends and decodes (#37303) 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
 2026-03-20 10:49:36 -07:00
Flora Feng
b4c1aef21c [Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 02:50:34 -07:00
Flora Feng
6050b93bed [Refactor] Move serve entrypoint tests under tests/entrypoints/serve/ (#37595) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 02:10:47 -07:00
Andreas Karatzas
37cd9fc107 [ROCm][CI] Remove deepep DBO tests on gfx90a (#37614) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-20 17:07:07 +08:00
Andreas Karatzas
9cfd4ebb5e [ROCm][CI] Update GSM8K eval config to use fp8-and-mixed models list (#37619) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-20 17:06:53 +08:00
Andreas Karatzas
bd8c4c0752 [CI] Removing deprecated rlhf examples reference (#37585) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-20 15:20:33 +08:00
Flora Feng
e2d1c8b5e8 [Refactor] Relocate entrypoint tests to match serving code structure (#37593) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-20 05:31:23 +00:00
Jee Jee Li
8fbe3f303f [Bugfix][LoRA] Fix Qwen35 LoRA (#36976) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2026-03-20 11:09:32 +08:00
Andreas Karatzas
040a505ff5 [ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-19 14:30:58 -05:00
Cyrus Leung
c7bc12c20f [CI/Build] Split out MM pooling tests (#37542) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-03-19 11:36:11 +00:00
TJian
da70c87e81 [CI] Fix wrong path test file, missing rlhf_async_new_apis.py (#37532) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2026-03-19 02:21:55 -07:00
Flora Feng
b21d384304 [Refactor] Relocate endpoint tests to mirror serving code directory structure (#37504) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-19 07:19:36 +00:00
sihao_li
9dade5da3a [XPU]Unify xpu test dependencies in dockerfile.xpu (#36477) 
Signed-off-by: sihao.li <sihao.li@intel.com>
 2026-03-19 08:12:07 +08:00
Itay Alroy
de1a86b7de elastic_ep: Fix stateless group port races (#36330) 
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
 2026-03-18 14:36:18 +00:00
Aaron Hao
47a1f11bff [docs] Add docs for new RL flows (#36188) 
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-18 09:04:26 +00:00
liuzhenwei
86b7e3c95a [XPU] skip unsupported ut and update test_nixl_connector (#37179) 
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
 2026-03-18 13:32:59 +08:00
Avinash Singh
c5030c439d [CI] Split Distributed Tests (4 GPUs) and Kernel MoE tests (#37100) 
Signed-off-by: Avinash Singh <avinashsingh.rcoem@gmail.com>
Signed-off-by: Avinash Singh  <107198269+avinashsingh77@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
 2026-03-17 11:44:55 -07:00
Richard Zou
979ff44cea [BugFix] PyTorch Compilation Tests should error if any test fails (#37300) 
Signed-off-by: Richard Zou <zou3519@gmail.com>
 2026-03-17 15:26:38 +00:00
Flora Feng
384dc7f77b [Refactor] Relocate completion and chat completion tests (#37125) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-17 11:31:23 +08:00
Kevin H. Luu
600a039f57 [CI] Shard Multi-Modal Models (Standard) into 4 parallel jobs (#37014) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-14 08:26:54 +00:00
Kevin H. Luu
74fe80ee95 [CI] Split Distributed Tests (4 GPUs) into 3 parallel jobs (#37015) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-14 12:21:13 +08:00
Flora Feng
bcfdadb1bc [Refactor] Relocate chat completion and anthropic tests (#36919) 
Signed-off-by: sfeng33 <4florafeng@gmail.com>
 2026-03-14 12:16:16 +08:00
Li, Jiang
092ace9e3a [UX] Improve UX of CPU backend (#36968) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-14 09:27:29 +08:00
Kevin H. Luu
f1816fb192 [CI] Split V1 e2e + engine (1 GPU) into separate jobs (#36945) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-13 14:16:02 -07:00
Andreas Karatzas
4fccd30f19 [ROCm][CI] Upgrading orchestrator to handle python pipeline markers and options (#36181) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-13 02:04:22 -07:00
Andreas Karatzas
99a57bdf74 [ROCm][CI] Corrected the GPT-OSS test root path (#36711) 
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
 2026-03-13 15:53:43 +08:00
Ryan Rock
a79c1c2c80 [AMD][Build] Add DeepEP to ROCm Dockerfile (#36086) 
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
 2026-03-12 21:33:32 +00:00