biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
14,386 Commits 2 Branches 140 Tags
fa6a6be51978bd4b49ba0da17039e60f96dc5b13
Commit Graph

1082 Commits

Author SHA1 Message Date
lkchen
a35a494745 [Bugfix] Add kwargs to RequestOutput __init__ to be forward compatible (#18513) 
Signed-off-by: Linkun <github@lkchen.net>
 2025-05-22 05:24:43 -07:00
Rabi Mishra
61acfc45bc [Bugfix][Failing Test] Fix test_events.py (#18460) 
Signed-off-by: rabi <ramishra@redhat.com>
 2025-05-21 04:57:28 -07:00
Kevin H. Luu
d981396778 [release] Change dockerhub username for TPU release (#18389) 2025-05-19 23:49:23 -07:00
Liangfu Chen
d565e0976f [neuron] fix authorization issue (#18364) 
Signed-off-by: Liangfu Chen <liangfc@amazon.com>
 2025-05-19 23:30:32 +00:00
Simon Mo
47fda6d089 [Build] Supports CUDA 12.6 and 11.8 after Blackwell Update (#18316) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-05-18 23:19:33 -07:00
Lucia Fang
3d2779c29a [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) 
Signed-off-by: Lucia Fang <fanglu@fb.com>
 2025-05-15 22:28:27 -07:00
Alexei-V-Ivanov-AMD
0b34593017 Adding "AMD: Tensorizer Test" to amdproduction. (#18216) 2025-05-15 11:01:25 -07:00
Alexei-V-Ivanov-AMD
566ec04c3d Adding "Basic Models Test" and "Multi-Modal Models Test (Extended) 3" in AMD Pipeline (#18106) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-15 08:49:23 -07:00
Mark McLoughlin
65334ef3b9 [V1][Metrics] Remove unused code (#18158) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2025-05-14 20:13:17 -07:00
Andrey Talman
09f106a91e Upload vllm index for the rc builds (#18173) 2025-05-14 16:35:56 -07:00
Charlie Fu
7b2f28deba [AMD][torch.compile] Enable silu+fp8_quant fusion for rocm (#18082) 
Signed-off-by: charlifu <charlifu@amd.com>
 2025-05-13 22:13:56 -07:00
Harry Mellor
009d9e7590 Convert benchmarks to ruff format (#18068) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-13 13:43:29 +00:00
Harry Mellor
98fcba1575 Convert .buildkite to ruff format (#17656) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-13 09:28:31 +00:00
Nick Hill
ee5be834e7 [BugFix] Fix 4-GPU RLHF tests (#18007) 
Signed-off-by: Nick Hill <nhill@redhat.com>
 2025-05-12 23:03:55 -07:00
Yang Wang
2b0db9b0e2 Enable standard language model for torhc nightly (#18004) 
Signed-off-by: Yang Wang <elainewy@meta.com>
 2025-05-12 14:00:04 -07:00
Alexei-V-Ivanov-AMD
e9c730c9bd Enabling "Weight Loading Multiple GPU Test - Large Models" (#18020) 2025-05-12 13:05:33 -07:00
Carol Zheng
b9fd0d7a69 [CI/Build] Fix TPU V1 Test mixed use of & and && across tests (#17968) 2025-05-12 12:06:59 -07:00
Jonathan Berkhahn
98ea35601c [Lora][Frontend]Add default local directory LoRA resolver plugin. (#16855) 
Signed-off-by: jberkhahn <jaberkha@us.ibm.com>
 2025-05-12 10:39:10 -07:00
Robert Shaw
d19110204c [P/D] NIXL Integration (#17751) 
Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Brent Salisbury <bsalisbu@redhat.com>
 2025-05-12 09:46:16 -07:00
Aaruni Aggarwal
9fbf2bfbd5 Correcting testcases in builkite job for IBM Power (#17675) 
Signed-off-by: Aaruni Aggarwal <aaruniagg@gmail.com>
 2025-05-12 08:11:55 +00:00
Alexei-V-Ivanov-AMD
3b602cdea7 AMD conditional all test execution // new test groups (#17556) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
 2025-05-09 15:35:58 -07:00
Michael Goin
8342e3abd1 [CI] Prune down lm-eval small tests (#17012) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-05-08 19:00:26 +00:00
yarongmu-google
a83a0f92b5 [Test] Attempt all TPU V1 tests, even if some of them fail. (#17334) 
Signed-off-by: Yarong Mu <ymu@google.com>
 2025-05-08 17:20:54 +00:00
Akshat Tripathi
c20ef40fd0 [Hardware][TPU][V1] Multi-LoRA implementation for the V1 TPU backend (#14238) 
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
 2025-05-07 16:28:47 -04:00
Michael Goin
950b71186f Replace lm-eval bash script with pytest and use enforce_eager for faster CI (#17717) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-05-06 18:00:10 -07:00
Michael Goin
e50a1f1a9c [TPU] Add kernel test for moe_pallas (#17496) 
Signed-off-by: Michael Goin <mgoin64@gmail.com>
 2025-05-06 17:59:57 -07:00
Harry Mellor
d6484ef3c3 Add full API docs and improve the UX of navigating them (#17485) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-03 19:42:43 -07:00
Kevin H. Luu
3ec97e2cc5 [release] Add command to clean up Docker containers/images in TPU release machine (#17606) 2025-05-02 18:54:34 -07:00
Yang Wang
b8b0859b5c add more pytorch related tests for torch nightly (#17422) 
Signed-off-by: Yang Wang <elainewy@meta.com>
 2025-05-02 03:29:59 -07:00
Cyrus Leung
48e925fab5 [Misc] Clean up test docstrings and names (#17521) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-01 05:19:32 -07:00
Cyrus Leung
afb4429b4f [CI/Build] Reorganize models tests (#17459) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-30 23:03:08 -07:00
Huy Do
2c4f59afc3 Update PyTorch to 2.7.0 (#16859) 2025-04-29 19:08:04 -07:00
Kevin H. Luu
4055130a85 [release] Always git fetch all to get latest tag on TPU release (#17322) 2025-04-29 17:52:11 -07:00
Alexei-V-Ivanov-AMD
608968b7c5 Enabling multi-group kernel tests. (#17115) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
 2025-04-29 10:27:27 -07:00
cascade
690fe019f0 [Feature] support sequence parallelism using compilation pass (#16155) 
Signed-off-by: cascade812 <cascade812@outlook.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
 2025-04-27 06:29:35 -07:00
Reid
3642c59aa8 [CI/Build] remove -t for run-lm-eval-gsm-hf-baseline.sh (#16271) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-04-26 18:25:05 +00:00
Aaruni Aggarwal
5adf6f6b7f Updating builkite job for IBM Power (#17111) 
Signed-off-by: Aaruni Aggarwal <aaruniagg@gmail.com>
 2025-04-24 10:06:17 -07:00
Michael Goin
14288d1332 Disable enforce_eager for V1 TPU sampler and structured output tests (#17016) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-24 02:50:09 -07:00
Michael Goin
6317a5174a Categorize tests/kernels/ based on kernel type (#16799) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-04-23 09:21:07 -04:00
Russell Bryant
ce17db8085 [CI] Run v1/test_serial_utils.py in CI (#16996) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-04-23 01:13:34 -07:00
Yang Wang
f67e9e9f22 add Dockerfile build vllm against torch nightly (#16936) 
Signed-off-by: Yang Wang <elainewy@meta.com>
 2025-04-22 19:08:27 -07:00
Chenyaaang
83d933718c [Core][V1][TPU] Enable structured decoding on TPU V1 (#16499) 
Signed-off-by: Chenyaaang <chenyangli@google.com>
 2025-04-22 18:05:23 -06:00
Alexei-V-Ivanov-AMD
5536b30a4c Fencing Kernels Tests for enabling on AMD (#16929) 
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
 2025-04-22 09:32:40 -07:00
Nicolò Lucchesi
210207525e [TPU][V1] Capture multimodal encoder during model compilation (#15051) 
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Siyuan Liu <lsiyuan@google.com>
 2025-04-21 18:36:59 -06:00
Michael Goin
71eda0bb76 Update Qwen1.5-MoE-W4A16-compressed-tensors.yaml (#16946) 2025-04-21 18:35:32 -06:00
Woosuk Kwon
4c41278b77 [CI/CD][V1] Add spec decode tests to CI (#16900) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-04-20 22:37:16 -07:00
omrishiv
5c9121203c [release] Publish neuron docker image (#16733) 
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
 2025-04-18 17:11:25 -07:00
Michael Goin
6a0f547561 Add hardware print to TPU V1 test (#16792) 2025-04-17 22:13:26 -07:00
Tarun Kumar
e37073efd7 Add property-based testing for vLLM endpoints using an API defined by an OpenAPI 3.1 schema (#16721) 
Signed-off-by: Tarun Kumar <takumar@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-04-17 21:08:27 -07:00
Robert Shaw
2b05b8ce69 [V1][Frontend] Improve Shutdown And Logs (#11737) 
Signed-off-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Andrew Feldman <afeldman@neuralmagic.com>
Co-authored-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-04-16 19:48:34 -07:00