biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Doc] Update V1 User Guide for Hardware and Models (#19474)

Browse Source 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Cyrus Leung
2025-06-11 15:49:06 +08:00
committed by GitHub
parent b8e809a057
commit 68b4a26149
2 changed files with 89 additions and 74 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/engine/arg_utils.py
View File

@@ -1440,7 +1440,8 @@ class EngineArgs:
_raise_or_fallback(feature_name=name, recommend_to_remove=False)
return False
# Non-[CUDA, TPU] may be supported on V1, but off by default for now.
# Non-[CUDA, TPU, x86 CPU] may be supported on V1,
# but off by default for now.
v0_hardware = not any(
(current_platform.is_cuda_alike(), current_platform.is_tpu(),
(current_platform.is_cpu()