biondizzle 3412ff1a9b fix: TMA tile strides must match global strides, not tile dimensions ...

The tile stride in the outer dimension should be the global row stride
(cols), not the tile width. The tile is a window into the global tensor
and elements are addressed with global strides.

2026-05-29 04:41:53 +00:00

..

archive

add back in the archived code

2026-05-28 07:04:59 +00:00

__init__.py

attention/: Clean up folder, archive backups, add detailed status headers

2026-05-28 07:01:33 +00:00

fmha_6warp_multihead.cuh

Multi-head FMHA kernel (Milestone 5): grid launch with MHA/MQA/batch support

2026-05-28 19:32:35 +00:00

fmha_6warp_multirow.cuh

fix: always normalize in kernel, correct KV merge with normalized O + LSE

2026-05-28 23:53:44 +00:00

fmha_6warp_tma.cuh

refactor: per-sub-tile TMA loads with padded GMEM allocations

2026-05-29 04:41:03 +00:00

fmha_6warp.cuh

6-warp specialized FMHA kernel — ALL HD=16/64/128/256 PASS cos 0.999997+

2026-05-28 16:34:14 +00:00

fmha_common.cuh

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_epilogue_sm100.cuh

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_qk_verify.cuh

debug: clean QK verify with scalar sanity + MMA result

2026-05-28 08:53:35 +00:00

fmha_sm100_launch.cu

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_sm100_tc.cuh

Rewrite fmha_sm100_tc.cuh with working N=16 PV sub-tile approach

2026-05-28 16:04:11 +00:00

fmha_sm100.cuh

docs: update here-docs with CuTeDSL rationale for NVIDIA

2026-05-28 07:54:01 +00:00

fmha_tma.cuh

fix: TMA tile strides must match global strides, not tile dimensions

2026-05-29 04:41:53 +00:00

fmha_umma_desc.cuh

UMMA: fix descriptor + idesc — use gau-nernst tutorial values

2026-05-28 09:18:45 +00:00

fmha.py

TMA 5D test: element stride decomposition

2026-05-28 19:18:01 +00:00

production.py

attention/: Clean up folder, archive backups, add detailed status headers

2026-05-28 07:01:33 +00:00