|
|
1f310defa0
|
fix: quantize_activation_nvfp4 returns 2 values, not 3
|
2026-05-25 03:17:13 +00:00 |
|
|
|
6dac3bcaf0
|
NVFP4-1.1: add FP4 quantize round-trip test (step 1 of kernel fusion)
|
2026-05-25 03:15:40 +00:00 |
|
|
|
eb46e4d15e
|
NVFP4-0.2-0.4: add FP4 primitives diagnostic test
|
2026-05-25 03:07:53 +00:00 |
|
|
|
29ad36934d
|
cleanup: remove D2 diagnostic/experimental files, keep working codebase clean
|
2026-05-25 02:40:12 +00:00 |
|
|
|
d5b69ac122
|
D2: simpler shape diagnostic using CuTe from Python (no kernel needed)
|
2026-05-25 02:36:41 +00:00 |
|
|
|
684e9a85fe
|
fix: use utils.sm100 instead of sm100 in diagnostic
|
2026-05-25 02:34:25 +00:00 |
|
|
|
7599801f57
|
D2: add flat_divide shape diagnostic kernel for multi-CTA grid
|
2026-05-25 02:33:15 +00:00 |
|
|
|
32850f6974
|
Update README, STAGE_D, STAGE_D2 with D1 rescale findings and D2 status
|
2026-05-25 01:18:48 +00:00 |
|
|
|
6cc151097e
|
Revert D2 multi-CTA attempts - keeping per-head launch approach (works correctly)
|
2026-05-25 01:08:38 +00:00 |
|
|
|
34f5beb767
|
D2: fix gC coordinate to match 5-mode flat_divide result
|
2026-05-24 23:44:39 +00:00 |
|
|
|
a3559538cf
|
D2: try 6-mode coordinate for flat_divide result
|
2026-05-24 23:43:23 +00:00 |
|
|
|
6f371d6b31
|
D2: add flat_divide shape print, try different coordinate order
|
2026-05-24 23:42:04 +00:00 |
|
|
|
7007a9db79
|
D2: use flat_divide for runtime coordinate indexing (like CUTLASS)
|
2026-05-24 23:40:37 +00:00 |
|
|
|
3e340a0eee
|
D2: fix local_tile coordinate for 4D Q (2 rest modes, not 3)
|
2026-05-24 23:38:48 +00:00 |
|
|
|
b5cd1b88c9
|
D2: add shape debug print for mQ/mK
|
2026-05-24 23:37:10 +00:00 |
|
|
|
df3146eb53
|
D2: hardcode a_major=MN for multi-CTA (Q is always MN-major in FMHA)
|
2026-05-24 23:35:49 +00:00 |
|
|
|
e809e71253
|
D2: use tensor indexing q[0] instead of local_tile for layout extraction
|
2026-05-24 23:34:38 +00:00 |
|
|
|
49c4189195
|
D2: fix LayoutEnum for multi-dim Q (use head-0 view for layout)
|
2026-05-24 23:33:27 +00:00 |
|
|
|
2b76b691cb
|
fix: block_idx() returns tuple, use [1] for y
|
2026-05-24 23:29:59 +00:00 |
|
|
|
4c79e5533e
|
D2: add multi-CTA grid with block_idx_y for Q/O head indexing
|
2026-05-24 23:27:38 +00:00 |
|
|
|
335e310c79
|
Update D2 status in README
|
2026-05-24 22:58:23 +00:00 |
|
|
|
e3e67c3992
|
NVFP4-3: enable 2-CTA UMMA when MMA tile M >= 256 (1.7-1.9x throughput)
|
2026-05-24 22:57:49 +00:00 |
|
|
|
e0339a92fc
|
D2: revert multi-CTA grid params (using per-head launch approach instead)
|
2026-05-24 22:52:21 +00:00 |
|
|
|
a5271821a8
|
D2: add scale test (more heads, larger hd)
|
2026-05-24 22:49:44 +00:00 |
|
|
|
d563c93fc5
|
D2: add per-head launch test
|
2026-05-24 22:48:22 +00:00 |
|
|
|
9b476d87f9
|
fix: compare un-normalized O against un-normalized reference
|
2026-05-24 22:44:11 +00:00 |
|
|
|
0ca7b58a6a
|
D1: fully revert LSE change back to original sfw_idx==0 guard
|
2026-05-24 22:41:32 +00:00 |
|
|
|
db353ec35a
|
D2: add simple n_h=1 regression test
|
2026-05-24 22:39:25 +00:00 |
|
|
|
4418e04a28
|
D1: revert per-row LSE to sfw_idx=0 for now (debugging D2 regression)
|
2026-05-24 22:28:11 +00:00 |
|
|
|
2cc66bff68
|
D2: add initial multi-head test file
|
2026-05-24 22:26:10 +00:00 |
|
|
|
49e66fb6e4
|
D1: corrected KV merge test with proper normalized output formula
|
2026-05-24 22:24:27 +00:00 |
|
|
|
c47f648617
|
fix lse verify
|
2026-05-24 22:23:08 +00:00 |
|
|
|
3577e09603
|
D1: add LSE verification test
|
2026-05-24 22:22:31 +00:00 |
|
|
|
674c5b9c18
|
D1: fix per-row LSE output + add KV merge test v2 with per-row LSE
|
2026-05-24 22:21:51 +00:00 |
|
|
|
18f3274c0b
|
D1: DEBUG - NO-OP O rescale (multiply by 1.0) to test TMEM round-trip
|
2026-05-24 22:19:16 +00:00 |
|
|
|
c33185ca0a
|
D1: add rescale diagnostic
|
2026-05-24 22:18:12 +00:00 |
|
|
|
02edff5ac7
|
D1: add KV merge test using log-sum-exp (avoids TMEM round-trip)
|
2026-05-24 22:17:24 +00:00 |
|
|
|
0f30319e06
|
Revert "D1: move O rescale atoms outside const_expr guard (match CUTLASS pattern)"
This reverts commit aaf21d8ac1.
|
2026-05-24 22:15:38 +00:00 |
|
|
|
aaf21d8ac1
|
D1: move O rescale atoms outside const_expr guard (match CUTLASS pattern)
|
2026-05-24 22:07:18 +00:00 |
|
|
|
35a3c04e8e
|
fix debug test
|
2026-05-24 22:04:51 +00:00 |
|
|
|
a391aa1fd3
|
D1: add rescale debug test
|
2026-05-24 22:04:20 +00:00 |
|
|
|
55c6903980
|
D1: fix O rescale identity tensor - use PV MMA shape not QK shape
|
2026-05-24 22:02:55 +00:00 |
|
|
|
f1aab1bfc1
|
D1: add multi-KV-tile O rescale test (s_k=256,384,512)
|
2026-05-24 22:00:42 +00:00 |
|
|
|
77b366d44b
|
Scrub B200 password from markdown files
|
2026-05-24 21:52:54 +00:00 |
|
|
|
83506e6ad2
|
Add MAY_24_26_PLAN.md: next session startup plan
|
2026-05-24 21:50:32 +00:00 |
|
|
|
9435bf9653
|
Restore NVFP4 Precision Roadmap + add O rescale gap to D1.5
|
2026-05-24 21:48:58 +00:00 |
|
|
|
03cbd8ffa6
|
Add STAGE_D2.md: Multi-query grid + head packing plan
|
2026-05-24 21:43:04 +00:00 |
|
|
|
f4e0315af9
|
Remove obsolete STAGE_D1.3.md and SMEM_P_GUIDANCE_REQUEST.md
|
2026-05-24 21:41:17 +00:00 |
|
|
|
dadfad8f89
|
Docs: Update STAGE_D.md, README.md with hd=512 compilation blocker, lessons learned
|
2026-05-24 21:35:25 +00:00 |
|
|
|
a5fef69363
|
D1.4: Use cutlass.range(unroll=1) for k_sub loops in both TMA and MMA warps
|
2026-05-24 17:55:33 +00:00 |
|
