Commit Graph

4 Commits

Author SHA1 Message Date
a5b47602b5 fix: remove n_kv_tiles from standalone test (struct doesn't have it anymore) 2026-05-30 10:28:38 +00:00
66b126ded8 P5: fix standalone test template — add n_kv_tiles to FmhaParams 2026-05-30 08:50:38 +00:00
3fd302e7a0 Fix nvcc goto-bypasses-init errors in multi-head test 2026-05-28 19:33:04 +00:00
aa41cfa2e5 Multi-head FMHA kernel (Milestone 5): grid launch with MHA/MQA/batch support
- fmha_6warp_multihead.cuh: grid=(1, n_h, batch) kernel with FmhaParams
- MQA support via k_head_stride=0 / v_head_stride=0
- LSE output for multi-segment KV merge composition
- test_fmha_6warp_multihead.cu: MHA (4+8 heads), MQA, batched tests
- HD-specific wrappers for hd=16/64/128/256
- Marked E2M1 dequant bug as FIXED in consultant issue file
2026-05-28 19:32:35 +00:00