CuTeDSL's grouped GEMM uses int32 for expert offsets internally. Our cumsum produced int64, causing a type mismatch inside a dynamic if-branch (prev_off changes from Int32 to Int64). Also cast tokens_per_expert to int32 before cumsum.
CuTeDSL's grouped GEMM uses int32 for expert offsets internally. Our cumsum produced int64, causing a type mismatch inside a dynamic if-branch (prev_off changes from Int32 to Int64). Also cast tokens_per_expert to int32 before cumsum.