biondizzle d47b2bfcce fix: use un-normalized P for multi-tile PV (correct online softmax merge)

2026-05-29 19:57:54 +00:00

..

archive

archive: TMA driver-API files + CUDA 13 TMA discovery notes

2026-05-29 06:52:39 +00:00

__init__.py

attention/: Clean up folder, archive backups, add detailed status headers

2026-05-28 07:01:33 +00:00

fmha_6warp_multihead.cuh

Multi-head FMHA kernel (Milestone 5): grid launch with MHA/MQA/batch support

2026-05-28 19:32:35 +00:00

fmha_6warp_multirow.cuh

fix: always normalize in kernel, correct KV merge with normalized O + LSE

2026-05-28 23:53:44 +00:00

fmha_6warp_tma_multirow.cuh

wip: add n_kv_tiles param for multi-tile KV (not yet used)

2026-05-29 19:47:48 +00:00

fmha_6warp_tma_multitile.cuh

fix: use un-normalized P for multi-tile PV (correct online softmax merge)

2026-05-29 19:57:54 +00:00

fmha_6warp_tma.cuh

fix: remove double normalization in TMA epilogue (P already normalized before PV)

2026-05-29 19:36:41 +00:00

fmha_6warp.cuh

6-warp specialized FMHA kernel — ALL HD=16/64/128/256 PASS cos 0.999997+

2026-05-28 16:34:14 +00:00

fmha_common.cuh

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_epilogue_sm100.cuh

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_qk_verify.cuh

debug: clean QK verify with scalar sanity + MMA result

2026-05-28 08:53:35 +00:00

fmha_sm100_launch.cu

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_sm100_tc.cuh

Rewrite fmha_sm100_tc.cuh with working N=16 PV sub-tile approach

2026-05-28 16:04:11 +00:00

fmha_sm100.cuh

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_tma.cuh

fix: smart quote in fmha_tma.cuh

2026-05-29 18:22:26 +00:00

fmha_umma_desc.cuh

fix: warp-stride for TMA canonical writes — only load warp calls them

2026-05-29 18:25:47 +00:00

fmha.py

TMA 5D test: element stride decomposition

2026-05-28 19:18:01 +00:00

production.py

attention/: Clean up folder, archive backups, add detailed status headers

2026-05-28 07:01:33 +00:00