biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032)

Browse Source 
Signed-off-by: kaixih <kaixih@nvidia.com>
This commit is contained in:
Kaixi Hou
2025-04-27 06:29:21 -07:00
committed by GitHub
parent 756848e79e
commit ed7a29d9f8
8 changed files with 403 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
csrc/quantization/fp4/nvfp4_scaled_mm_kernels.cu
View File

@@ -134,7 +134,7 @@ typename T::Gemm::Arguments args_from_options(
using StrideB = typename T::StrideB;
using StrideD = typename T::StrideD;
using Sm100BlkScaledConfig =
typename T::Gemm::GemmKernel::CollectiveMainloop::Sm100BlkScaledConfig;
typename T::Gemm::GemmKernel::CollectiveMainloop::Sm1xxBlkScaledConfig;
int m = static_cast<int>(M);
int n = static_cast<int>(N);