biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
7,056 Commits 2 Branches 140 Tags
a45b979d9fe4e700a81256ad314a9d5fd65a2829
Commit Graph

1072 Commits

Author SHA1 Message Date
wang.yuqi
3952731e8f [New Model]: Support Qwen3 Embedding & Reranker (#19260) 2025-06-10 20:07:30 -07:00
Russell Bryant
da9b523ce1 [Docs] Note that alternative structured output backends are supported (#19426) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-06-10 16:20:00 +00:00
Louie Tsai
9368cc90b2 Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930) 
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
 2025-06-10 06:22:05 +00:00
Anna Pendleton
32b3946bb4 Add clear documentation around the impact of debugging flag (#19369) 
Signed-off-by: Anna Pendleton <pendleton@google.com>
 2025-06-10 06:16:09 +00:00
Harry Mellor
c016047ed7 Fix docs/mkdocs/hooks/remove_announcement.py (#19382) 2025-06-09 21:36:54 -07:00
Michael Yao
c57c9415b1 [Docs] Fix a bullet list in usage/security.md (#19358) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-06-09 13:28:51 +00:00
Se7en
0eca5eacd0 [Doc] Fix description in the Automatic Prefix Caching design doc (#19333) 
Signed-off-by: cr7258 <chengzw258@163.com>
 2025-06-09 17:30:02 +08:00
Reid
12e5829221 [doc] improve ci doc (#19307) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-09 07:26:12 +00:00
Luis Vega
cb6d572e85 [Model] NemotronH support (#18863) 
Signed-off-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
Co-authored-by: Luis Vega <2478335+vegaluisjose@users.noreply.github.com>
 2025-06-05 21:29:28 +00:00
Reid
78dcf56cb3 [doc] small fix (#19167) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-05 09:13:50 +08:00
Cyrus Leung
8f4ffbd373 [Doc] Update V1 Guide for embedding models (#19141) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-04 22:57:55 +08:00
Xu Wenqing
02658c2dfe Add DeepSeek-R1-0528 function call chat template (#18874) 
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
 2025-06-04 13:24:18 +00:00
Isotr0py
8711bc5e68 [Misc] Add packages for benchmark as extra dependency (#19089) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-06-04 04:18:48 -07:00
Li, Jiang
4555143ea7 [CPU] V1 support for the CPU backend (#16441) 2025-06-03 18:43:01 -07:00
Russell Bryant
52dceb172d [Docs] Add developer doc about CI failures (#18782) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-06-04 01:09:13 +00:00
Reid
01eee40536 [doc] update docker version (#19074) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-03 19:08:21 +00:00
Simon Mo
02f0c7b220 [Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
youkaichao
4e88723f32 [doc] clarify windows support (#19088) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-06-03 21:42:17 +08:00
Cyrus Leung
118ff92111 [Doc] Update V1 user guide for embedding and enc-dec models (#19060) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-03 02:29:41 -07:00
Jee Jee Li
42243fbda0 [Doc] Add InternVL LoRA support (#19055) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-06-03 09:08:03 +00:00
Michael Goin
6d18ed2a2e Update docker docs with ARM CUDA cross-compile (#19037) 
Signed-off-by: mgoin <michael@neuralmagic.com>
 2025-06-03 08:21:53 +00:00
Chen Zhang
f32fcd9444 [v1][KVCacheManager] Rename BlockHashType to BlockHash (#19015) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-06-03 08:01:48 +00:00
Lu Fang
d32aa2e670 [Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) 
Signed-off-by: Lu Fang <lufang@fb.com>
 2025-06-03 00:16:17 -07:00
汪志鹏
1282bd812e Add tarsier model support (#18985) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-06-03 13:13:13 +08:00
Gregory Shtrasberg
9e6f61e8c3 [ROCm][Build] Clean up the ROCm build (#19040) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2025-06-02 20:47:47 -07:00
Hyogeun Oh (오효근)
5bc1ad6cee [Doc] Remove duplicate TOCs during MkDocs migration (#19021) 
Signed-off-by: Zerohertz <ohg3417@gmail.com>
 2025-06-02 19:49:48 -07:00
Reid
5b168b6d7a [doc] add pytest tips (#19010) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-02 11:07:26 +00:00
Reid
432ec9926e [doc] wrong output (#19000) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-01 11:26:14 +00:00
Reid
c594cbf565 [doc] small fix - mkdocs (#18996) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-31 20:23:43 -07:00
Reid
749f5bdd38 [doc] fix the list rendering issue - security.md (#18982) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-31 10:39:21 +00:00
Lukas Geiger
0f71e24034 [Docs] Correct multiprocessing design doc (#18964) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-05-31 01:30:15 +00:00
Isotr0py
5a8641638a [VLM] Add PP support and fix GPTQ inference for Ovis models (#18958) 
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-05-30 17:11:44 +00:00
Reid
ec6833c5e9 [doc] show the count for fork and watch (#18950) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-30 06:45:59 -07:00
Reid
8f8900cee9 [doc] add mkdocs doc (#18930) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-30 07:58:44 +00:00
Cyrus Leung
4f4a6b844a [Deprecation] Remove mean pooling default for Qwen2EmbeddingModel (#18913) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-30 06:53:37 +00:00
H
5acf828d99 [docs] fix: fix markdown syntax (#18927) 2025-05-30 05:20:48 +00:00
Hyogeun Oh (오효근)
6f2909405e [Doc] Fix codeblocks formatting in LoRA adapters documentation (#18907) 
Signed-off-by: Zerohertz <ohg3417@gmail.com>
 2025-05-29 07:38:55 -07:00
Jee Jee Li
7fcfd954ff [Bugfix] Fix misleading information in the documentation (#18845) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-05-29 02:54:14 -07:00
Reid
e740d07f07 [doc] add CLI doc (#18871) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-29 09:51:36 +00:00
Michael Yao
a652e71dd0 [Doc] Remove redundant spaces from compatibility_matrix.md (#18891) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-05-29 02:51:20 -07:00
aws-elaineyz
1661a9c28f [Doc][Neuron] Update documentation for Neuron (#18868) 
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
 2025-05-28 19:44:01 -07:00
Mark McLoughlin
0e98964e94 [V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2025-05-28 18:54:12 +00:00
Cyrus Leung
4318c0559d [CI/Build] Remove imports of built-in re (#18750) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 09:19:18 +00:00
Cyrus Leung
753944fa9b [Doc] Update reproducibility doc and example (#18741) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 07:03:13 +00:00
Cyrus Leung
25a817f202 [Doc] Update OOT model docs (#18742) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 06:30:31 +00:00
Reid
1f88dbd2bb [Misc] improve web section group title display (#18684) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-27 04:35:16 +00:00
Cyrus Leung
82e2339b06 [Doc] Move examples and further reorganize user guide (#18666) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-26 07:38:04 -07:00
Cyrus Leung
9553fdb41e [Doc] Improve API docs (#18713) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-26 07:33:34 -07:00
Reid
0665e29998 [Misc] add AutoGen integration (#18712) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-26 13:56:18 +00:00
Cyrus Leung
fba0642704 [CI/Build][Doc] Update gte-Qwen2-1.5B-instruct usage (#18683) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-05-25 20:27:50 -07:00