biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Chore] Separate out optional dependency checks from vllm.utils (#27207)

Browse Source 
Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
This commit is contained in:
dongbo910220
2025-10-22 22:44:21 +08:00
committed by GitHub
parent 49c00fe304
commit 3ae082c373
22 changed files with 60 additions and 64 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
tests/kernels/attention/test_deepgemm_attention.py
View File

@@ -6,7 +6,7 @@ import pytest
import torch
from vllm.platforms import current_platform
from vllm.utils import cdiv, has_deep_gemm
from vllm.utils import cdiv
from vllm.utils.deep_gemm import (
_ceil_to_ue8m0,
calc_diff,
@@ -15,6 +15,7 @@ from vllm.utils.deep_gemm import (
get_num_sms,
get_paged_mqa_logits_metadata,
)
from vllm.utils.import_utils import has_deep_gemm
def kv_cache_cast_to_fp8(x: torch.Tensor) -> torch.Tensor: