|
|
0822b3476c
|
SMEM counter: separate allocate_tensor instead of struct field
|
2026-05-22 20:35:42 +00:00 |
|
|
|
4ff379fc3d
|
Fix SMEM counter type: cutlass.Int32 for MemRange
|
2026-05-22 20:35:17 +00:00 |
|
|
|
8d6fe8075d
|
SMEM-backed kv_coord counter — JIT can't constant-fold SMEM reads
|
2026-05-22 20:34:52 +00:00 |
|
|
|
e90e25c6da
|
DEBUG: hardcoded Int32(1) to test if TMA can read tile 1
|
2026-05-22 20:34:21 +00:00 |
|
|
|
f522490d3a
|
DEBUG: use Int32(kt) directly to test if coordinate matters
|
2026-05-22 20:34:03 +00:00 |
|
|
|
8889fe5766
|
Test: kv_coord = warp_idx() * 0 — force SSA from runtime value
|
2026-05-22 20:33:40 +00:00 |
|
|
|
8a7446a2c1
|
DEBUG: add cute.printf for kv_coord runtime value
|
2026-05-22 20:33:03 +00:00 |
|
|
|
cef4bcf686
|
Test: Python range() instead of cutlass.range() for TMA loop
|
2026-05-22 20:32:44 +00:00 |
|
|
|
4a102a9953
|
Test example9: drop try_acquire/pk, single loop-carried kv_coord
|
2026-05-22 20:32:25 +00:00 |
|
|
|
2aa6e4d234
|
REVERT to working example7 (n=128 cos 0.999998). Example8 TMA fix didn't work.
|
2026-05-22 20:28:15 +00:00 |
|
|
|
fa1f5b8ef6
|
Update stage_c test to example8: SSA kv_coord + per-tile O rescale
|
2026-05-22 20:27:58 +00:00 |
|
|
|
594efdcbc0
|
Clean up tests: archive superseded files, keep only essential unit tests
Kept in tests/unit/:
- test_fmha_v3.py (stages A+B)
- test_fmha_v3_diag.py (identity softmax, n=128+256)
- test_fmha_v3_stage_c.py (real softmax, n=128 cos 0.999998)
- layertest.py + cudagraph_test.py (required for every change)
- infrastructure: cache, custom_op, cutedsl, router, fp4, fused, interleave
Archived: 19 superseded unit tests + 10 root-level scratch files
Root level: only fmha_v3_stage_c_example7.py remains (now in unit/)
|
2026-05-22 20:25:27 +00:00 |
|
|
|
52857aee16
|
Revert TMA to kt pattern (n=128 works), multi-tile TMA is separate bug
|
2026-05-22 20:10:35 +00:00 |
|
|
|
dc9a5bc499
|
TMA: use self.n_kv_tiles + kv_coord pattern from working diag test
|
2026-05-22 20:08:07 +00:00 |
|
|
|
e96eb789a0
|
REVERT to 0bdcdc0 — the version that passed n=128 cos 0.999998
|
2026-05-22 20:07:18 +00:00 |
|
|
|
ad6ea439a4
|
DEBUG: disable O rescale + normalize, test if corr setup alone causes regression
|
2026-05-22 19:57:53 +00:00 |
|
|
|
4fe88a6994
|
Shared corr tensors for O rescale + final normalize, fix softmax loop
|
2026-05-22 19:55:06 +00:00 |
|
|
|
7a2c62c7fc
|
Add O rescale with correction_rescale pattern + fix TMA to working diag pattern
|
2026-05-22 19:51:53 +00:00 |
|
|
|
f31f4210eb
|
O normalize: exact CUTLASS correction_rescale pattern with 2D reg tensor
|
2026-05-22 19:50:37 +00:00 |
|
|
|
ea3de238b3
|
O normalize: TMEM round-trip with paired Ld/St atoms + standard epilogue_tma_store
|
2026-05-22 19:49:51 +00:00 |
|
|
|
642f715091
|
Fix: use NamedBarrier instead of mbarrier_arrive/wait
|
2026-05-22 19:49:07 +00:00 |
|
|
|
b1bd8bc8ac
|
Fix: barrier_wait → mbarrier_wait, barrier_arrive → mbarrier_arrive
|
2026-05-22 19:48:31 +00:00 |
|
|
|
d3b49c9998
|
Fix epilogue: corr_tile_size=16, proper epi_subtile tuple, match CUTLASS reference
|
2026-05-22 19:47:57 +00:00 |
|
|
|
633a272988
|
Fix example7: K slice (None,None,0,0) and softmax scale_log2 double-bug
|
2026-05-22 19:45:59 +00:00 |
|
|
|
1212b663c3
|
Fix: fence_async_shared -> fence_view_async_shared
|
2026-05-22 19:25:05 +00:00 |
|
|
|
e229155d01
|
Clean v2: real softmax P, no O TMEM modify, standard epilogue. Baseline for custom epilogue work.
|
2026-05-22 19:24:25 +00:00 |
|
|
|
06941c317d
|
O normalize using tmem_ptr base (same as epilogue) + CUTLASS sub-tile pattern
|
2026-05-22 19:18:16 +00:00 |
|
|
|
877ebb7584
|
O normalize with full layout (no sub-tiling), Repetition(64)
|
2026-05-22 19:17:03 +00:00 |
|
|
|
e0a604c508
|
Disable ALL O copies to verify baseline
|
2026-05-22 19:14:33 +00:00 |
|
|
|
64d174fdf6
|
Disable O rescale too for NO-OP test
|
2026-05-22 19:13:43 +00:00 |
|
|
|
5a0b575bfe
|
DEBUG: O load+store NO-OP to verify TMEM copy correctness
|
2026-05-22 19:12:43 +00:00 |
|
|
|
c2fe1bffb5
|
Re-enable O rescale + normalize with corr_tile_size=32
|
2026-05-22 19:11:17 +00:00 |
|
|
|
95d3d1bf03
|
Disable O rescale + normalize, verify softmax P only
|
2026-05-22 19:09:33 +00:00 |
|
|
|
69ec2ce7e5
|
FIX: O sub-tile count should be HEAD_DIM/corr_tile_size, not 128/corr_tile_size
|
2026-05-22 19:06:52 +00:00 |
|
|
|
c4de6aa5e7
|
Full pipeline: O rescale + final normalize with CUTLASS sub-tile approach
|
2026-05-22 19:05:59 +00:00 |
|
|
|
1626ab9ec5
|
Test softmax P vs unnormalized reference (no O normalize)
|
2026-05-22 19:05:27 +00:00 |
|
|
|
d0f0af8099
|
O normalize using CUTLASS reference sub-tile approach
|
2026-05-22 19:04:37 +00:00 |
|
|
|
d6eefc8813
|
Fix O normalize: use 2D register tensor indexing
|
2026-05-22 18:59:15 +00:00 |
|
|
|
3c26ad25d3
|
Add O normalization with sub-tile TMEM read-modify-write
|
2026-05-22 18:58:35 +00:00 |
|
|
|
b21b0f4703
|
Simplify: softmax P only, no O rescale/normalize yet
|
2026-05-22 18:57:00 +00:00 |
|
|
|
a38c8d4140
|
Real softmax test built on working identity diag
|
2026-05-22 18:55:31 +00:00 |
|
|
|
eea70fbda8
|
CRITICAL FIX: remove extra scale_log2 in softmax (minus_row_max and acc_scale)
|
2026-05-22 18:52:58 +00:00 |
|
|
|
95cc5e6ee5
|
FIX: K slice (None,None,0,0) like working diag
|
2026-05-22 18:51:22 +00:00 |
|
|
|
364e64fdeb
|
Diag: identity softmax on example6 pipeline to isolate softmax bug
|
2026-05-22 18:49:33 +00:00 |
|
|
|
454445dd2a
|
Quick test: working v3 with n=256 multi-tile
|
2026-05-22 18:47:54 +00:00 |
|
|
|
c7514de0ae
|
DEBUG: add version marker to confirm code changes are running
|
2026-05-22 18:47:05 +00:00 |
|
|
|
20aa6b4d90
|
CRITICAL FIX: TMA pre-slice (None,0,None,0) → (None,None,0,0) to keep GMEM tile dim free
|
2026-05-22 18:45:55 +00:00 |
|
|
|
5ac4f483de
|
Diag: TMA shapes with hardcoded major modes
|
2026-05-22 18:43:55 +00:00 |
|
|
|
f4abc4c115
|
Diag: simplified TMA shape analysis
|
2026-05-22 18:43:30 +00:00 |
|
|
|
1e26764664
|
Diag: print TMA partition shapes for multi-tile debugging
|
2026-05-22 18:43:05 +00:00 |
|
