biondizzle
4b9eed02e1
- Deleted fmha.py (CuTeDSL slow path), FmhaKernel, Python KV merge - Deleted fmha_sm100.cuh, fmha_sm100_tc.cuh, fmha_sm100_launch.cu, fmha_epilogue_sm100.cuh - Moved fmha_qk_verify.cuh to tests/unit/qk_verify_kernel.cuh - Deleted decode_sparse.py, decode_swa.py, kernels/decode/ - Deleted 46 test_d*.py probes, test_smem_*, test_cotiled_*, test_tmem_*, test_smem_p_*, test_ultra_minimal, test_fmha_pv16, test_working_softmax_maybe - Deleted root scratch: debug_linear.py, test_mapping.py, run_router_tests.py - Moved archive/ to archived_plans/code_archive/ - Rewrote production.py: single fast path via 6-warp multi-tile kernel - Added STATUS.md, audit_attention_live.md - Moved NEXT_PRIORITIES*.md to archived_plans/
2.7 KiB
2.7 KiB
Attention Directory Audit (C1)
dsv4/kernels/attention/ files
| File | Refs from live code | Action |
|---|---|---|
fmha_6warp_tma_multirow_multitile.cuh |
fmha_multitile_capi.cu (include) | KEEP - production kernel |
fmha_common.cuh |
fmha_6warp_tma_multirow_multitile.cuh (include) | KEEP - shared defs |
fmha_tma.cuh |
fmha_6warp_tma_multirow_multitile.cuh (include) | KEEP - TMA helpers |
fmha_umma_desc.cuh |
fmha_multitile_capi.cu (include) | KEEP - UMMA descriptors |
fmha_multitile_capi.cu |
fmha_multitile_op.py (nvcc compile) | KEEP - C API wrapper |
fmha_multitile_op.py |
production.py:312 (import) | KEEP - ctypes loader |
production.py |
init.py, custom_ops.py, layers/attention.py, tests | KEEP - public API |
__init__.py |
layers/attention.py | KEEP - public API |
fmha.py |
production.py:53 (FmhaKernel import), ~48 test files | DELETE (C3 Option A) |
fmha_sm100.cuh |
Only referenced by files being deleted | DELETE |
fmha_sm100_tc.cuh |
Zero live refs | DELETE |
fmha_sm100_launch.cu |
Zero live refs | DELETE |
fmha_epilogue_sm100.cuh |
Only ref is fmha_sm100_launch.cu (deleting) | DELETE |
fmha_qk_verify.cuh |
Only ref is tests/unit/test_qk_mma.cu | MOVE to tests/unit/ |
archive/ (5 files) |
Zero live refs | MOVE to archived_plans/code_archive/ |
dsv4/ops/ dead files
| File | Refs | Action |
|---|---|---|
decode_sparse.py |
Zero | DELETE |
decode_swa.py |
Zero | DELETE |
dsv4/kernels/decode/ (entire dir)
| File | Refs | Action |
|---|---|---|
__init__.py |
Zero | DELETE dir |
_NOTES_fp8_bf16.md |
Zero | DELETE dir |
Root-level scratch
| File | Action |
|---|---|
debug_linear.py |
DELETE |
test_mapping.py |
DELETE |
run_router_tests.py |
DELETE (hardcoded B200 path) |
tests/working_softmax_maybe.py |
DELETE |
test_d*.py count: 46 → target ≤5
All 46 reference FmhaKernel (being deleted) or are Stage D probes. All DELETE under C3 Option A.
test_smem_acc.py — imports FmhaKernel from archive. DELETE.
test_cotiled_diag.py, test_fmha_v3_stage_d1.py, test_tmem_roundtrip_minimal.py, test_smem_budget.py — import FmhaKernel. DELETE with C3.
Live test files (KEEP):
- test_p3_fast_decode.py (tests multitile op)
- test_p6_tma_epilogue.py (tests multitile op)
- test_p7_multi_row_softmax.py (tests multitile op)
- test_production.py (tests production API)
- test_fmha_sm100.py (tests standalone .cu compile)
- All test_*.cu files (standalone CUDA, don't import FmhaKernel)
- test_nvfp4_*.py (quantization tests)
- test_cutedsl.py (CuTeDSL infra)
Live .cuh count after cleanup: 4 (fmha_6warp_tma_multirow_multitile, fmha_common, fmha_tma, fmha_umma_desc) Live .cu count: 1 (fmha_multitile_capi.cu)