biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[CPU] Support for Whisper (#30062)

Browse Source 
Signed-off-by: Aditya Tewari <aditya.tewari@arm.com>
This commit is contained in:
Aditya Tewari
2025-12-10 12:58:42 +00:00
committed by GitHub
parent 53d2420b44
commit cebda2a4af
5 changed files with 49 additions and 24 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
csrc/cpu/cpu_attn.cpp
View File

@@ -117,7 +117,6 @@ torch::Tensor get_scheduler_metadata(
input.casual = casual;
input.isa = isa;
input.enable_kv_split = enable_kv_split;
TORCH_CHECK(casual, "Only supports casual mask for now.");
VLLM_DISPATCH_FLOATING_TYPES(dtype, "get_scheduler_metadata", [&]() {
CPU_ATTN_DISPATCH_CASE_HEADDIM(head_dim, [&] {