biondizzle 97656a5cd1 Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong ...

Key fixes:
- PipelineUmmaAsync consumer group: 32*4=128 threads (not 4 warps)
- TMEM offsets computed from find_tmem_tensor_col_offset (not hardcoded)
- P fragment from p_tmem_s.outer + make_fragment_A (matching fmha.py)
- V SMEM aliasing via recast_ptr

Status:
- Stage A: cosine 0.999999 ✅
- Stage B: runs without crash, identity softmax cosine -0.02 ❌
- Diagnostics: TMEM layout inspection, bisection results

2026-05-20 20:26:25 +00:00

..

cudagraph_test.py

fix: test L2 weight N dim should be hidden_size, not hidden_size//2

2026-05-16 19:07:36 +00:00

debug_output.py

Update CURRENT_BUG.md: current status, outstanding garbage output issue, hypotheses

2026-05-17 16:52:40 +00:00

debug_stages.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

diag_tmem.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

layertest.py

Fused SwiGLU epilogue with granularity-8 weight interleave

2026-05-20 04:13:52 +00:00

requirements.txt

test: add standalone layer 0 comparison test (no vLLM, no Docker)

2026-05-16 02:13:18 +00:00

run_test.sh

fix: use setup.py install for CUTLASS extension build

2026-05-16 02:21:17 +00:00

stage_b_debug5.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_attention_path_b200.py

Add attention path test: pinpoint FlashMLA failure

2026-05-19 07:54:01 +00:00

test_attention.py

Add NVFP4 linear runner + attention projection test

2026-05-18 20:14:03 +00:00

test_b_layout.py

cleanup: move useful tests to tests/, nuke stale debug tests

2026-05-16 02:14:37 +00:00

test_blackwell_attn_b200.py

Add blackwell_attention module and comprehensive test

2026-05-19 15:30:29 +00:00

test_compile_custom_op.py

Fix compile test: add warmup for activation global scales

2026-05-19 01:57:16 +00:00

test_csa_attention_b200.py

Add CSA/HCA attention kernel (PyTorch SDPA, Blackwell-safe)

2026-05-19 07:58:10 +00:00

test_csa_sparse_attn_b200.py

Fix N for C128A (need 128 tokens)

2026-05-19 16:04:53 +00:00

test_custom_op.py

Replace autograd.Function with torch.library.custom_op for Dynamo compat

2026-05-19 01:54:48 +00:00

test_cutedsl.py

fix: B tensor K-major strides, scale_b axis swap

2026-05-16 03:04:31 +00:00

test_decode_attention_b200.py

Fix attention for decode (1 query vs N cached KVs)

2026-05-19 15:28:52 +00:00

test_decode_pipeline.py

feat: GPU-native SWA + sparse decode attention kernels (CuTeDSL)

2026-05-20 05:46:15 +00:00

test_decode_vs_prefill_b200.py

Add decode vs prefill consistency test

2026-05-19 16:00:33 +00:00

test_e2e_decode_b200.py

Test with all 61 layers (shared experts only)

2026-05-19 15:55:41 +00:00

test_fp4_roundtrip.py

chore: deprecate prepare_weights_from_dequantized and prepare_weights_direct

2026-05-20 02:11:40 +00:00

test_full_layer_b200.py

Fix checkpoint keys: attn_hc.*, compressor.*, q_a_proj/q_b_proj/kv_proj

2026-05-19 07:17:37 +00:00

test_full_layer_nan_b200.py

Add full layer NaN test (attention + MoE, multi-layer chain)

2026-05-19 18:36:49 +00:00

test_full_model_b200.py

Add full model forward test (WIP), sparse attention test passes

2026-05-19 09:04:19 +00:00

test_fused_step1.py

wip: add run_fused_swiglu_grouped_gemm bridge + step1 test

2026-05-20 03:10:56 +00:00

test_interleave_gemm.py

wip: fused SwiGLU kernel scaffold + bridge interleave + plan

2026-05-20 03:04:38 +00:00

test_interleave.py

wip: fused SwiGLU kernel scaffold + bridge interleave + plan

2026-05-20 03:04:38 +00:00

test_inv_rope.py

Add unit tests for NVFP4 weight mapper and inverse RoPE BF16

2026-05-19 03:22:00 +00:00

test_kv_cache_b200.py

Fix kv_ref transpose in KV cache test

2026-05-19 08:58:46 +00:00

test_model_forward_b200.py

Rewrite test: diagnose whether warmup gs matters at inference time

2026-05-19 07:49:41 +00:00

test_moe_nan_b200.py

Fix intermediate size: 3072 not 18432

2026-05-19 18:34:12 +00:00

test_moe_runner_nan_b200.py

Use 16 experts for MoE runner test (fits in memory)

2026-05-19 18:35:40 +00:00

test_multilayer.py

Add MoE scale ratio output

2026-05-17 22:58:27 +00:00

test_nvfp4_attention_b200.py

Fix cos_sin cache shape in NVFP4 attention test

2026-05-19 08:38:55 +00:00

test_nvfp4_attn_gemm_b200.py

Fix NVFP4 attention: slice output to actual N after 128-padding

2026-05-19 08:55:31 +00:00

test_nvfp4_mapper.py

Fix hc_head mapping: checkpoint uses hc_head.hc_fn, model params are flat hc_head_fn

2026-05-19 03:58:25 +00:00

test_o_projection_b200.py

Fix dims: o_groups=16, o_lora_rank=1024 from config

2026-05-19 06:37:25 +00:00

test_o_projection.py

Patch attention forward: BF16 inv RoPE + BMM wo_a + NVFP4 wo_b

2026-05-19 06:30:18 +00:00

test_pipeline_real_weights.py

Pipeline test: use max_num_tokens=8192 matching vLLM

2026-05-17 23:04:44 +00:00

test_quick_rand.py

cleanup: move useful tests to tests/, nuke stale debug tests

2026-05-16 02:14:37 +00:00

test_rope_kv_b200.py

Fix syntax in RoPE KV test

2026-05-19 10:31:07 +00:00

test_runner_vs_pipeline.py

test: runner vs pipeline comparison + scale assembly comparison

2026-05-17 07:33:20 +00:00

test_scale_assembly.py

fix: separate L1/L2 scale buffers (different K_sf), fix assembly calls

2026-05-17 07:43:05 +00:00

test_scale_debug.py

test: scale assembly debug

2026-05-17 07:37:47 +00:00

test_shared_expert.py

Fix hidden_size: shared expert uses 7168, not HC_DIM 28672

2026-05-18 20:10:32 +00:00

test_silu_step1.py

wip: add run_fused_swiglu_grouped_gemm bridge + step1 test

2026-05-20 03:10:56 +00:00

test_sparse_attn_b200.py

Add CSA/HCA sparse attention kernel test

2026-05-19 09:02:12 +00:00

test_sparse_decode.py

feat: GPU-native SWA + sparse decode attention kernels (CuTeDSL)

2026-05-20 05:46:15 +00:00

test_stage_a_copy.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_a_minimal.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_a_pv_created.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_a_pv_param.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_a_qk.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_a_v2.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_a_with_pv_mma.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_debug2.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_debug3.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_debug4.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_debug.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_identity.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_minimal.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_pipeline_only.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_v1.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_v2.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_v3.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_v4.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_v5.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_v6.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_stage_b_v7.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_step2_subtile_v2.py

wip: Step 2 gate/up pairing — SiLU validated, runtime conditionals blocked by CuTeDSL

2026-05-20 03:26:20 +00:00

test_step2_subtile.py

wip: Step 2 gate/up pairing — SiLU validated, runtime conditionals blocked by CuTeDSL

2026-05-20 03:26:20 +00:00

test_tmem_addressing.py

Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong

2026-05-20 20:26:25 +00:00

test_uniform_fp4.py

cleanup: move useful tests to tests/, nuke stale debug tests

2026-05-16 02:14:37 +00:00

test_v4_attention_b200.py

Add DeepSeek-V4 CSA/HCA attention pipeline test (not MLA)

2026-05-19 08:51:16 +00:00

test_vllm_codepaths_b200.py

Fix imports in vLLM codepaths test

2026-05-19 17:26:50 +00:00

test_warmup_gs.py

test: use runner's built-in warmup method

2026-05-17 08:24:27 +00:00

test_wo_a_bmm.py

Fix BF16 wo_a: per-group BMM instead of flat linear

2026-05-19 04:10:02 +00:00

test_wo_a.py

Fix test: cos_sin_cache on CUDA device

2026-05-19 02:37:50 +00:00