biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
14,985 Commits 2 Branches 140 Tags
738d0a281fab2e151a67b370c26b4e4360362f8f
Commit Graph

122 Commits

Author SHA1 Message Date
SoluMilken
d8f8a7aad2 [Misc] Sync pre-commit to 4.5.1 in workflows and docs (#36675) 
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-16 10:03:21 +00:00
Harry Mellor
e39257a552 Add AGENTS.md (#36877) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-12 10:20:50 -07:00
Mark McLoughlin
5282c7d4d0 [docs] Add lightweight AI assisted contribution policy (#30947) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2026-03-12 11:46:13 +00:00
Harry Mellor
a0f44bb616 Allow markdownlint to run locally (#36398) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2026-03-08 20:05:24 -07:00
Abhishek Mathukiya
f3dc292e9f docs: add version requirement note for --profiler-config flag (#32454) 
Signed-off-by: abhishkh <mathukiya.a@northeastern.edu>
 2026-03-04 18:13:54 +00:00
jonoillar
26e722f906 [DOC][BugFix] Specfiy build dependency installation (#34513) 
Signed-off-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>
Co-authored-by: Jon OILLARBURU <jon.oillarburu@multiversecomputing.com>
 2026-02-25 08:04:06 +00:00
Cyrus Leung
987506bca6 [Refactor] Simplify dummy data generation (#35025) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-02-22 20:55:27 -08:00
rinbaro
007b183d74 [docs] fix unintentional misspellings (#33863) 
Signed-off-by: rinbaro <ilgomishra@gmail.com>
 2026-02-04 20:50:59 -08:00
Muhammad Hashmi
535de06cb1 [Model] Add transcription support for Qwen3-Omni (#29828) 
Signed-off-by: Muhammad Hashmi <mhashmi@berkeley.edu>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
 2026-02-04 21:17:47 +00:00
Matthew Bonanni
a608b4c6c2 [5/N][Attention] Finish eliminating vllm/attention folder (#32064) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-01-27 10:02:51 -05:00
Cyrus Leung
dcd80206b7 [Chore] Update type annotation of input_ids in model forward (#33063) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-26 06:02:10 -08:00
Cyrus Leung
61274bdef5 [Doc] Further update multi-modal impl doc (#33065) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-26 10:54:20 +00:00
Cyrus Leung
09194b90a5 [Doc] Update docs for MM model development with context usage (#32691) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-20 10:37:35 -08:00
Cyrus Leung
9ea07b41da [1/N] Reorganize multimodal processing code (#32327) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2026-01-14 15:25:31 +00:00
Roy Wang
44c34f22d9 [Doc] Update installation from source command (#32239) 
Signed-off-by: esmeetu <jasonailu87@gmail.com>
 2026-01-12 23:10:27 -08:00
Andrew Bennett
f243abc92d Fix various typos found in docs (#32212) 
Signed-off-by: Andrew Bennett <potatosaladx@meta.com>
 2026-01-13 03:41:47 +00:00
Matthew Bonanni
2612ba9285 [1/N][Attention] Restructure attention: move files (#31916) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2026-01-09 13:10:24 -08:00
rongfu.leng
887e900b77 [Docs] Add profiler user docs for http request (#31370) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-12-26 23:48:15 +08:00
Andrey Talman
268a972c62 Update Pytorch version update docs (#30982) 2025-12-19 16:08:53 +00:00
Benjamin Chislett
e858bfe051 [Cleanup] Refactor profiling env vars into a CLI config (#29912) 
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-12-09 13:29:33 -05:00
Cyrus Leung
e83b7e379c Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199) 2025-12-07 00:00:22 -08:00
Cyrus Leung
27f4c2fd46 [Renderer] Separate out RendererConfig from ModelConfig (#30145) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-12-06 23:15:42 -08:00
Shengqi Chen
990f806473 [Doc] clarify nightly builds in developer docs (#30019) 
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
 2025-12-05 00:28:37 +08:00
Finbarr Timbers
38caf7fa1a Update FAQ on interleaving sliding windows support (#29796) 
Signed-off-by: Finbarr Timbers <finbarrtimbers@gmail.com>
 2025-12-01 19:15:19 +00:00
Yifei Zhang
1ab8fc8197 Make PyTorch profiler gzip and CUDA time dump configurable (#29568) 
Signed-off-by: Yifei Zhang <yifei.zhang1992@outlook.com>
 2025-12-01 04:30:46 +00:00
Cyrus Leung
ccbdf51bd5 [Doc] Reorganize benchmark docs (#29658) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-11-28 17:19:25 +08:00
rongfu.leng
480598958e [Feature][Bench] Add pareto visualization (#29477) 
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
 2025-11-27 23:53:20 -08:00
Matthew Bonanni
430dd4d9eb [Attention] Remove imports from vllm/attention/__init__.py (#29342) 
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
 2025-11-26 10:53:15 -07:00
Roger Wang
0ff70821c9 [Core] Deprecate xformers (#29262) 
Signed-off-by: Roger Wang <hey@rogerw.io>
 2025-11-24 04:18:55 +00:00
Cyrus Leung
aab0102a26 [V0 deprecation] Remove more V0 references (#29088) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-11-21 11:56:59 +00:00
Shanshan Shen
d44e9df7d4 [Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487) 
Signed-off-by: shen-shanshan <467638484@qq.com>
 2025-11-19 16:24:55 +00:00
Didier Durand
083cf326dc [Doc]: fix typos in various files (#28863) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-11-17 20:32:14 -08:00
Didier Durand
63fed55506 [Doc]: fix typos in various files (#28811) 
Signed-off-by: Didier Durand <durand.didier@gmail.com>
 2025-11-16 14:30:06 +00:00
Harry Mellor
67187554dd [Docs] Enable some more markdown lint rules for the docs (#28731) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-11-14 18:39:19 +00:00
Julien Denize
085424808e Remove audio optional dependency for mistral-common (#28722) 
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-11-14 09:54:38 -08:00
Harry Mellor
5f3cd7f7f2 [Docs] Update the name of Transformers backend -> Transformers modeling backend (#28725) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-11-14 16:34:14 +00:00
Harry Mellor
97d1c99302 Rename clashing method names for vLLM model protocol (#27583) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-11-12 19:14:33 -08:00
Benjamin Chislett
975676d174 [Feat] Drop-in Torch CUDA Profiler (#27841) 
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
 2025-11-08 14:07:37 -08:00
Kuntai Du
8bff831f0a [Benchmark] Cleanup deprecated nightly benchmark and adjust the docstring for performance benchmark (#25786) 
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
 2025-10-30 04:43:37 +00:00
Cyrus Leung
ecca3fee76 [Frontend] Add vllm bench sweep to CLI (#27639) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-29 05:59:48 -07:00
Matvei Pashkovskii
130aa8cbcf Add load pattern configuration guide to benchmarks (#26886) 
Signed-off-by: Matvei Pashkovskii <mpashkov@amd.com>
Signed-off-by: Matvei Pashkovskii <matvei.pashkovskii@amd.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-28 10:49:15 -07:00
Cyrus Leung
8fb7b2fab9 [Doc] Fix links to GH projects (#27530) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-26 17:55:51 +08:00
Cyrus Leung
ceacedc1f9 [Benchmark] Add plot utility for parameter sweep (#27168) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-21 20:30:03 -07:00
Huy Do
becb7de40b Update PyTorch to 2.9.0+cu129 (#24994) 
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
 2025-10-21 17:20:18 -04:00
Cyrus Leung
b3aba04e5a [Benchmark] Convenience script for multiple parameter combinations (#27085) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-18 23:57:01 -07:00
dongbo910220
a1946c9f61 [Chore] Separate out profiling utilities from vllm.utils (#27150) 
Signed-off-by: dongbo910220 <1275604947@qq.com>
 2025-10-18 19:12:01 +00:00
Harry Mellor
483ea64611 [Docs] Replace all explicit anchors with real links (#27087) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-17 02:22:06 -07:00
Harry Mellor
4ffd6e8942 [Docs] Reduce custom syntax used in docs (#27009) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-10-16 20:05:34 -07:00
Cyrus Leung
ef9676a1f1 [Doc] ruff format some Python examples (#26767) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-10-14 03:21:53 -07:00
Maximilien de Bayser
fe3edb4cf0 Add support for the /rerank endpoint in vllm bench serve (#26602) 
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
 2025-10-14 04:25:43 +00:00