Files
nvfp4-megamoe-kernel/cutedsl
biondizzle 44b40d41fe fix: compile CuTeDSL kernel with real tensors, not dummy shapes
The kernel's TMA descriptors are sized from compilation-time shapes.
Dummy 256x256 caused wrong memory access for real 3584x6144 data.
Now compiles with actual runtime tensors on first use, cached by
(num_experts, K, N). Compilation happens once during warmup.
Forward call remains cudagraph-safe.
2026-05-16 20:05:59 +00:00
..