biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix][V1] Avoid importing PreTrainedModel (#15366)

Browse Source 
Signed-off-by: Hollow Man <hollowman@opensuse.org>
This commit is contained in:
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟
2025-03-24 12:33:12 +02:00
committed by GitHub
parent 5797fb97e9
commit 948ab03e7e
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/model_loader/utils.py
View File

@@ -32,7 +32,7 @@ def set_default_torch_dtype(dtype: torch.dtype):
def is_transformers_impl_compatible( def is_transformers_impl_compatible(
arch: str, arch: str,
module: Optional[transformers.PreTrainedModel] = None) -> bool: module: Optional["transformers.PreTrainedModel"] = None) -> bool:
mod = module or getattr(transformers, arch, None) mod = module or getattr(transformers, arch, None)
if mod is None: if mod is None:
return False return False