biondizzle/nvfp4-megamoe-kernel
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,112 Commits 1 Branch 17 Tags
1f310defa00a586fb2e1f26d2e7524b269c6e978
Commit Graph

486 Commits

Author SHA1 Message Date
biondizzle
1f310defa0 fix: quantize_activation_nvfp4 returns 2 values, not 3 2026-05-25 03:17:13 +00:00
biondizzle
6dac3bcaf0 NVFP4-1.1: add FP4 quantize round-trip test (step 1 of kernel fusion) 2026-05-25 03:15:40 +00:00
biondizzle
eb46e4d15e NVFP4-0.2-0.4: add FP4 primitives diagnostic test 2026-05-25 03:07:53 +00:00
biondizzle
29ad36934d cleanup: remove D2 diagnostic/experimental files, keep working codebase clean 2026-05-25 02:40:12 +00:00
biondizzle
d5b69ac122 D2: simpler shape diagnostic using CuTe from Python (no kernel needed) 2026-05-25 02:36:41 +00:00
biondizzle
684e9a85fe fix: use utils.sm100 instead of sm100 in diagnostic 2026-05-25 02:34:25 +00:00
biondizzle
7599801f57 D2: add flat_divide shape diagnostic kernel for multi-CTA grid 2026-05-25 02:33:15 +00:00
biondizzle
6cc151097e Revert D2 multi-CTA attempts - keeping per-head launch approach (works correctly) 2026-05-25 01:08:38 +00:00
biondizzle
4c79e5533e D2: add multi-CTA grid with block_idx_y for Q/O head indexing 2026-05-24 23:27:38 +00:00
biondizzle
a5271821a8 D2: add scale test (more heads, larger hd) 2026-05-24 22:49:44 +00:00
biondizzle
d563c93fc5 D2: add per-head launch test 2026-05-24 22:48:22 +00:00
biondizzle
9b476d87f9 fix: compare un-normalized O against un-normalized reference 2026-05-24 22:44:11 +00:00
biondizzle
db353ec35a D2: add simple n_h=1 regression test 2026-05-24 22:39:25 +00:00
biondizzle
4418e04a28 D1: revert per-row LSE to sfw_idx=0 for now (debugging D2 regression) 2026-05-24 22:28:11 +00:00
biondizzle
2cc66bff68 D2: add initial multi-head test file 2026-05-24 22:26:10 +00:00
biondizzle
49e66fb6e4 D1: corrected KV merge test with proper normalized output formula 2026-05-24 22:24:27 +00:00
biondizzle
c47f648617 fix lse verify 2026-05-24 22:23:08 +00:00
biondizzle
3577e09603 D1: add LSE verification test 2026-05-24 22:22:31 +00:00
biondizzle
674c5b9c18 D1: fix per-row LSE output + add KV merge test v2 with per-row LSE 2026-05-24 22:21:51 +00:00
biondizzle
c33185ca0a D1: add rescale diagnostic 2026-05-24 22:18:12 +00:00
biondizzle
02edff5ac7 D1: add KV merge test using log-sum-exp (avoids TMEM round-trip) 2026-05-24 22:17:24 +00:00
biondizzle
35a3c04e8e fix debug test 2026-05-24 22:04:51 +00:00
biondizzle
a391aa1fd3 D1: add rescale debug test 2026-05-24 22:04:20 +00:00
biondizzle
f1aab1bfc1 D1: add multi-KV-tile O rescale test (s_k=256,384,512) 2026-05-24 22:00:42 +00:00
biondizzle
c11ac38ceb D1.4: Remove --opt-level 0 from hd512 test (use default opt level) 2026-05-24 16:42:01 +00:00
biondizzle
b14d88f37f D1.4: Fix merge test - use use_smem_p=False for hd=256 kernel (SMEM budget) 2026-05-24 16:36:48 +00:00
biondizzle
e6c9e6c0d0 D1.4: Add external k_sub merge test for hd=512 (avoids slow in-kernel k_sub compilation) 2026-05-24 16:31:06 +00:00
biondizzle
13fcf16b14 D1.4: Use --opt-level 0 only (ptxas -j not supported, MLIR is the bottleneck) 2026-05-24 15:43:17 +00:00
biondizzle
b4da412b30 D1.4: Use options string for compile flags (--ptxas-options -j64 --opt-level 0) 2026-05-24 15:40:39 +00:00
biondizzle
4f69dffc93 D1.4: Add PtxasOptions -j64 + OptLevel(0) for faster hd=512 compilation 2026-05-24 15:36:35 +00:00
biondizzle
331ddb29b7 D1.4: Fix regression test for un-normalized O output (D5a) 2026-05-24 15:13:16 +00:00
biondizzle
449a6e7ede Fix: add cutlass import to test_d1_qk512 2026-05-24 14:20:32 +00:00
biondizzle
ce267909ad Fix: add cpasync import to test_d1_qk512 2026-05-24 14:20:01 +00:00
biondizzle
625837fd44 D1.4: Add hd=512 QK-only and standalone test for compilation debugging 2026-05-24 14:19:26 +00:00
biondizzle
592873b560 D1.4: Reduce pv_n_tile to 128 for hd=512 to fit SMEM budget (192KB) 2026-05-24 08:07:32 +00:00
biondizzle
787d0160a1 D1: Full test with TMEM-P at hd=64,128,256,512 2026-05-24 04:07:40 +00:00
biondizzle
24b9ebfba9 D1: SMEM-P test at hd=128 2026-05-24 03:48:37 +00:00
biondizzle
0f50933f69 D1: Fix SMEM-P (coordinate store), LSE (FP32), add TMEM-P-only test 2026-05-24 03:27:14 +00:00
biondizzle
f645f3994a D1: LSE diagnostic at various hd 2026-05-24 03:23:16 +00:00
biondizzle
c042fcf6c7 D1: Add diagnostic test (TMEM-P vs SMEM-P at various hd) 2026-05-24 03:22:23 +00:00
biondizzle
1c5d6475e5 D1 test: compare un-norm O + norm using ref row_sum + LSE verification 2026-05-24 03:21:01 +00:00
biondizzle
93e7fe97f7 D1.5: Always output un-normalized O + LSE (epilogue_tma_store only, no TMEM round-trip normalize) 2026-05-24 03:18:38 +00:00
biondizzle
8010e3dda2 test: add try/except for SMEM-P coord test 2026-05-24 02:15:07 +00:00
biondizzle
16bade9e10 test: use FmhaKernel for SMEM-P coord test 2026-05-24 01:59:25 +00:00
biondizzle
f2d95da4aa test: SMEM-P coordinate verification test 2026-05-24 01:58:32 +00:00
biondizzle
394f08601a fix: proper v_major from tensor 2026-05-24 01:55:37 +00:00
biondizzle
384de55dfd fix: COL_MAJOR 2026-05-24 01:54:30 +00:00
biondizzle
313f2c77cd fix: hardcode v_major for diag test 2026-05-24 01:54:20 +00:00
biondizzle
268265ba0b diag: use FmhaKernel setup for cotiled test 2026-05-24 01:54:08 +00:00
biondizzle
32d8483443 fix: v_major derivation in cotiled diag 2026-05-24 01:53:40 +00:00