biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
8,250 Commits 2 Branches 140 Tags
24d1dffbeb0d27cf42904153f56e919fb01b5a07
Commit Graph

225 Commits

Author SHA1 Message Date
H
24d1dffbeb [executor] feat: add supports_pp attr to executors (#21786) 
Signed-off-by: Haibin Lin <haibin.lin@bytedance.com>
 2025-08-03 18:04:45 +08:00
Rui Qiao
4ac8437352 [Misc] Getting and passing ray runtime_env to workers (#22040) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-08-01 23:54:40 -07:00
Rui Qiao
d331759488 Introduce RayPPCommunicator for ray-based PP (#21660) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-08-01 11:50:58 -07:00
wuhang
e6680f9e25 [Bugfix] Add log prefix in non-dp mode engine core (#21889) 
Signed-off-by: wuhang <wuhang6@huawei.com>
 2025-08-01 09:04:16 +00:00
Cyrus Leung
46d81d6951 [V1] Get supported tasks from model runner instead of model config (#21585) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-25 05:36:45 -07:00
Michael Goin
82ec66f514 [V0 Deprecation] Remove Prompt Adapters (#20588) 
Signed-off-by: mgoin <mgoin64@gmail.com>
 2025-07-23 16:36:48 -07:00
Joe Runde
b77c7d327f [BugFix] Fix ray import error mem cleanup bug (#21381) 
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>
 2025-07-22 16:19:55 -07:00
Rui Qiao
35bc8bd5fb [Misc] Copy HF_TOKEN env var to Ray workers (#21406) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-22 16:18:42 -07:00
Ratnam Parikh
90f1e55421 [Intel GPU] Ray Compiled Graph avoid NCCL for Intel GPU (#21338) 
Signed-off-by: ratnampa <ratnam.parikh@intel.com>
 2025-07-21 21:48:27 -07:00
Rui Qiao
217937221b Elastic Expert Parallel Initial Support (#20775) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-18 17:46:09 -07:00
Cyrus Leung
45badd05d0 [Core] Set pooling params based on task and model (#21128) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-07-18 05:41:17 -07:00
Kunshang Ji
b6e7e3d58f [Intel GPU] support ray as distributed executor backend for XPU. (#20659) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-07-09 00:36:58 -07:00
Rui Qiao
a6d795d593 [DP] Copy environment variables to Ray DPEngineCoreActors (#20344) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-07-07 10:14:22 -07:00
Kunshang Ji
b69781f107 [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) 
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
 2025-06-26 09:27:18 -07:00
Chauncey
12575cfa7a [Bugfix] fix RAY_CGRAPH_get_timeout is not set successfully (#19725) 
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
 2025-06-18 10:26:16 -07:00
Simon Mo
02f0c7b220 [Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Hyogeun Oh (오효근)
a68e293cb9 [Doc] Convert Sphinx directives ( {class}, {meth}, {attr}, ...) to MkDocs format for better documentation linking (#18663) 
Signed-off-by: Zerohertz <ohg3417@gmail.com>
 2025-05-27 01:44:20 -07:00
Chenguang Li
cebc22f3b6 [Misc]Replace cuda hard code with current_platform in Ray (#14668) 
Signed-off-by: noemotiovon <757486878@qq.com>
 2025-05-24 20:26:31 -07:00
Harry Mellor
a1fe24d961 Migrate docs from Sphinx to MkDocs (#18145) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-23 02:09:53 -07:00
Lucia Fang
3d2779c29a [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) 
Signed-off-by: Lucia Fang <fanglu@fb.com>
 2025-05-15 22:28:27 -07:00
Harry Mellor
d6484ef3c3 Add full API docs and improve the UX of navigating them (#17485) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-03 19:42:43 -07:00
Lifu Huang
5aa6efb9a5 [Misc] Clean up redundant code in uniproc_executor.py (#16762) 
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
 2025-04-24 22:49:30 -07:00
Eric Tang
ddb94c2605 [core] Add tags parameter to wake_up() (#15500) 
Signed-off-by: Eric <erictang000@gmail.com>
 2025-04-02 01:59:27 -07:00
Rui Qiao
8dd41d6bcc [Misc] Use envs.VLLM_USE_RAY_COMPILED_DAG_CHANNEL_TYPE (#15831) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-04-01 06:07:53 -07:00
Rui Qiao
5797fb97e9 [Misc] Remove ignore_reinit_error for ray.init() (#15373) 2025-03-24 07:41:53 +00:00
Rui Qiao
4c69e228b3 [Misc] Increase RayDistributedExecutor RAY_CGRAPH_get_timeout (#15301) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-03-21 22:25:43 -07:00
Cody Yu
5df2da5b97 [Misc] Better RayExecutor and multiprocessing compatibility (#14705) 
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
 2025-03-20 19:27:46 -07:00
Woosuk Kwon
0c6f5023c3 [V1] Scheduler Refactoring [1/N] - Add Scheduler Interface (#15250) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-03-20 17:50:43 -07:00
Richard Liu
a8f12a63fd Fix env vars for running Ray distributed backend on GKE (#15166) 
Signed-off-by: Richard Liu <ricliu@google.com>
 2025-03-20 14:59:33 +00:00
Alessandro Sangiorgi
374ee287d8 [Frontend] Remove custom_cache_manager (#13791) 
Signed-off-by: fulvius31 <asangior@redhat.com>
 2025-03-20 00:13:50 +08:00
Li, Jiang
ff47aab056 [CPU] Upgrade CPU backend to torch-2.6 (#13381) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-03-12 10:41:13 +00:00
Alexander Matveev
cb8bdfade2 [V1] TPU - Add tensor parallel support via Ray (#13618) 
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
 2025-03-08 08:19:38 -05:00
Rui Qiao
abcc61e0af [misc] Mention ray list nodes command to troubleshoot ray issues (#14318) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-03-06 02:00:36 +00:00
Zhe Zhang
47d4a7e004 Small update for external_launcher backend docs (#14288) 2025-03-05 21:30:00 +08:00
Rui Qiao
bf13d40972 [core] Pass all driver env vars to ray workers unless excluded (#14099) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-03-04 11:44:17 +08:00
Rui Qiao
084bbac8cc [core] Bump ray to 2.43 (#13994) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-02-28 21:47:44 +00:00
Rui Qiao
06c8f8d885 [bugfix] Fix profiling for RayDistributedExecutor (#13945) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-02-28 01:01:21 +08:00
Rui Qiao
c9944acbf9 [misc] Rename Ray ADAG to Compiled Graph (#13928) 2025-02-26 20:03:28 -08:00
Chenguang Li
e1fe7591f2 [Misc]Code Cleanup (#13859) 
Signed-off-by: noemotiovon <noemotiovon@gmail.com>
Co-authored-by: noemotiovon <noemotiovon@gmail.com>
 2025-02-26 10:44:30 +08:00
Rui Qiao
9ba28043b5 [misc] Show driver IP info when Ray fails to allocate driver worker (#13858) 
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
 2025-02-26 09:53:43 +08:00
Nichols A. Romero
fa82074167 [Bugfix] Flush TunableOp results before worker processes are destroyed. (#13623) 
Signed-off-by: Nichols A. Romero <nick.romero@amd.com>
 2025-02-25 11:08:20 +00:00
Rui Qiao
3173c3b34e [misc] Clean up ray compiled graph type hints (#13731) 2025-02-25 00:37:08 -08:00
cjackal
51010a1807 [Misc] set single whitespace between log sentences (#13771) 
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
 2025-02-25 10:26:12 +08:00
youkaichao
eb24dc4a45 [v1] torchrun compatibility (#13642) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-02-23 22:47:24 +08:00
Cody Yu
fbbe1fbac6 [MISC] Logging the message about Ray teardown (#13502) 
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Rui Qiao <161574667+ruisearch42@users.noreply.github.com>
 2025-02-19 09:40:50 -08:00
Mengqing Cao
238dfc8ac3 [MISC] tiny fixes (#13378) 2025-02-17 00:57:13 -08:00
Jun Duan
556ef7f714 [Misc] Log time consumption of sleep and wake-up (#13115) 
Signed-off-by: Jun Duan <jun.duan.phd@outlook.com>
 2025-02-14 20:10:21 +08:00
Rui Qiao
9605c1256e [V1][core] Implement pipeline parallel on Ray (#12996) 2025-02-13 08:02:46 +00:00
Mengqing Cao
9cf4759493 [executor] init local_rank as device index (#13027) 
Signed-off-by: Mengqing Cao <cmq0113@163.com>
 2025-02-11 21:20:53 +08:00
Russell Bryant
c320ca8edd [Core] Don't do platform detection at import time (#12933) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-02-11 07:25:25 +00:00