Tokens must be laid out as [expert0_tokens | expert1_tokens | ...] for the 2Dx3D grouped GEMM. Each expert gets its own contiguous block of tokens. Scale factors split by expert offsets.
Tokens must be laid out as [expert0_tokens | expert1_tokens | ...] for the 2Dx3D grouped GEMM. Each expert gets its own contiguous block of tokens. Scale factors split by expert offsets.