biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Platforms] Add device_type in Platform (#10508)

Browse Source 
Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
Mengqing Cao
2024-11-21 12:44:20 +08:00
committed by GitHub
parent 6c1208d083
commit 9d827170a3
10 changed files with 11 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/platforms/rocm.py
View File

@@ -29,6 +29,7 @@ if os.environ.get("VLLM_WORKER_MULTIPROC_METHOD", None) in ["fork", None]:
class RocmPlatform(Platform):
_enum = PlatformEnum.ROCM
device_type: str = "cuda"
@classmethod
def get_default_attn_backend(cls, selected_backend: _Backend) -> _Backend: