biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Platforms] Add device_type in Platform (#10508)

Browse Source 
Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
Mengqing Cao
2024-11-21 12:44:20 +08:00
committed by GitHub
parent 6c1208d083
commit 9d827170a3
10 changed files with 11 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/platforms/hpu.py
View File

@@ -5,6 +5,7 @@ from .interface import Platform, PlatformEnum, _Backend
class HpuPlatform(Platform):
_enum = PlatformEnum.HPU
device_type: str = "hpu"
@classmethod
def get_default_attn_backend(cls, selected_backend: _Backend) -> _Backend: