biondizzle/nvfp4-megamoe-kernel
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
0dc6fe4a7de7c4a84cd86f252cc41284bb042a12
nvfp4-megamoe-kernel/tests
History
biondizzle 0dc6fe4a7d Stage B progress: PV works for square (128,128), broken for (128,64) 
- Bug 1 (V MN-major): Fix applied
- Bug 2 (softmax packing): Confirmed correct (V=I test: cosine 1.0)
- Bug 3 (ACCUMULATE): Fix applied (first PV must overwrite, not accumulate)
- Bug 4 (CURRENT): PV MMA broken for non-square output
  - (128,128) PV with random V: cosine 0.999999 ✅
  - (128,64) PV with MN-major V: cosine ~0.01 ❌
  - Softmax packing, layout aliasing, pipeline ordering all verified correct
  - Root cause unknown — likely epilogue/V layout/MMA tiler issue

Added test_pv_diag.py (V=I and random V, 128x128 output — PASS)
Added test_layout_compare.py (TMEM layout inspection)
Added test_inspect_types.py (TMEM pointer arithmetic verification)
Updated test_mma_si_pv.py with head_dim param, pv_mma_tiler_mn fix, ACCUMULATE fix
Updated READMEs with current state
2026-05-21 04:40:28 +00:00
..
cudagraph_test.py
fix: test L2 weight N dim should be hidden_size, not hidden_size//2
2026-05-16 19:07:36 +00:00
debug_output.py
Update CURRENT_BUG.md: current status, outstanding garbage output issue, hypotheses
2026-05-17 16:52:40 +00:00
debug_stages.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
diag_layouts.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
diag_tmem.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
layertest.py
Fused SwiGLU epilogue with granularity-8 weight interleave
2026-05-20 04:13:52 +00:00
requirements.txt
test: add standalone layer 0 comparison test (no vLLM, no Docker)
2026-05-16 02:13:18 +00:00
run_test.sh
fix: use setup.py install for CUTLASS extension build
2026-05-16 02:21:17 +00:00
stage_b_debug5.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_afrag_roundtrip.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_attention_path_b200.py
Add attention path test: pinpoint FlashMLA failure
2026-05-19 07:54:01 +00:00
test_attention.py
Add NVFP4 linear runner + attention projection test
2026-05-18 20:14:03 +00:00
test_b_afrag2.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_b_layout.py
cleanup: move useful tests to tests/, nuke stale debug tests
2026-05-16 02:14:37 +00:00
test_bf16_elemwise.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_bf16_pack.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_bf16_recast_full.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_bf16_recast_simple.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_blackwell_attn_b200.py
Add blackwell_attention module and comprehensive test
2026-05-19 15:30:29 +00:00
test_compile_custom_op.py
Fix compile test: add warmup for activation global scales
2026-05-19 01:57:16 +00:00
test_csa_attention_b200.py
Add CSA/HCA attention kernel (PyTorch SDPA, Blackwell-safe)
2026-05-19 07:58:10 +00:00
test_csa_sparse_attn_b200.py
Fix N for C128A (need 128 tokens)
2026-05-19 16:04:53 +00:00
test_custom_op.py
Replace autograd.Function with torch.library.custom_op for Dynamo compat
2026-05-19 01:54:48 +00:00
test_cutedsl.py
fix: B tensor K-major strides, scale_b axis swap
2026-05-16 03:04:31 +00:00
test_decode_attention_b200.py
Fix attention for decode (1 query vs N cached KVs)
2026-05-19 15:28:52 +00:00
test_decode_pipeline.py
feat: GPU-native SWA + sparse decode attention kernels (CuTeDSL)
2026-05-20 05:46:15 +00:00
test_decode_vs_prefill_b200.py
Add decode vs prefill consistency test
2026-05-19 16:00:33 +00:00
test_e2e_decode_b200.py
Test with all 61 layers (shared experts only)
2026-05-19 15:55:41 +00:00
test_error_pattern.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_fp4_roundtrip.py
chore: deprecate prepare_weights_from_dequantized and prepare_weights_direct
2026-05-20 02:11:40 +00:00
test_full_layer_b200.py
Fix checkpoint keys: attn_hc.*, compressor.*, q_a_proj/q_b_proj/kv_proj
2026-05-19 07:17:37 +00:00
test_full_layer_nan_b200.py
Add full layer NaN test (attention + MoE, multi-layer chain)
2026-05-19 18:36:49 +00:00
test_full_model_b200.py
Add full model forward test (WIP), sparse attention test passes
2026-05-19 09:04:19 +00:00
test_fused_step1.py
wip: add run_fused_swiglu_grouped_gemm bridge + step1 test
2026-05-20 03:10:56 +00:00
test_inspect_types.py
Stage B progress: PV works for square (128,128), broken for (128,64)
2026-05-21 04:40:28 +00:00
test_interleave_gemm.py
wip: fused SwiGLU kernel scaffold + bridge interleave + plan
2026-05-20 03:04:38 +00:00
test_interleave.py
wip: fused SwiGLU kernel scaffold + bridge interleave + plan
2026-05-20 03:04:38 +00:00
test_inv_rope.py
Add unit tests for NVFP4 weight mapper and inverse RoPE BF16
2026-05-19 03:22:00 +00:00
test_kv_cache_b200.py
Fix kv_ref transpose in KV cache test
2026-05-19 08:58:46 +00:00
test_layout_compare.py
Stage B progress: PV works for square (128,128), broken for (128,64)
2026-05-21 04:40:28 +00:00
test_mma_si_only.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_mma_si_pv.py
Stage B progress: PV works for square (128,128), broken for (128,64)
2026-05-21 04:40:28 +00:00
test_model_forward_b200.py
Rewrite test: diagnose whether warmup gs matters at inference time
2026-05-19 07:49:41 +00:00
test_moe_nan_b200.py
Fix intermediate size: 3072 not 18432
2026-05-19 18:34:12 +00:00
test_moe_runner_nan_b200.py
Use 16 experts for MoE runner test (fits in memory)
2026-05-19 18:35:40 +00:00
test_multilayer.py
Add MoE scale ratio output
2026-05-17 22:58:27 +00:00
test_nvfp4_attention_b200.py
Fix cos_sin cache shape in NVFP4 attention test
2026-05-19 08:38:55 +00:00
test_nvfp4_attn_gemm_b200.py
Fix NVFP4 attention: slice output to actual N after 128-padding
2026-05-19 08:55:31 +00:00
test_nvfp4_mapper.py
Fix hc_head mapping: checkpoint uses hc_head.hc_fn, model params are flat hc_head_fn
2026-05-19 03:58:25 +00:00
test_o_projection_b200.py
Fix dims: o_groups=16, o_lora_rank=1024 from config
2026-05-19 06:37:25 +00:00
test_o_projection.py
Patch attention forward: BF16 inv RoPE + BMM wo_a + NVFP4 wo_b
2026-05-19 06:30:18 +00:00
test_packing_diag.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_pair_swap2.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_pair_swap.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_pipeline_real_weights.py
Pipeline test: use max_num_tokens=8192 matching vLLM
2026-05-17 23:04:44 +00:00
test_pv_diag.py
Stage B progress: PV works for square (128,128), broken for (128,64)
2026-05-21 04:40:28 +00:00
test_pv_mma_mn_major.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_quick_rand.py
cleanup: move useful tests to tests/, nuke stale debug tests
2026-05-16 02:14:37 +00:00
test_recast_minimal.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_rope_kv_b200.py
Fix syntax in RoPE KV test
2026-05-19 10:31:07 +00:00
test_runner_vs_pipeline.py
test: runner vs pipeline comparison + scale assembly comparison
2026-05-17 07:33:20 +00:00
test_scale_assembly.py
fix: separate L1/L2 scale buffers (different K_sf), fix assembly calls
2026-05-17 07:43:05 +00:00
test_scale_debug.py
test: scale assembly debug
2026-05-17 07:37:47 +00:00
test_shared_expert.py
Fix hidden_size: shared expert uses 7168, not HC_DIM 28672
2026-05-18 20:10:32 +00:00
test_silu_step1.py
wip: add run_fused_swiglu_grouped_gemm bridge + step1 test
2026-05-20 03:10:56 +00:00
test_softmax_only.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_sparse_attn_b200.py
Add CSA/HCA sparse attention kernel test
2026-05-19 09:02:12 +00:00
test_sparse_decode.py
feat: GPU-native SWA + sparse decode attention kernels (CuTeDSL)
2026-05-20 05:46:15 +00:00
test_stage_a_copy.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_a_minimal.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_a_pv_created.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_a_pv_param.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_a_qk.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_a_v2.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_a_with_pv_mma.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_afrag2.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_afrag.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_debug2.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_debug3.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_debug4.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_debug.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_diag.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_final.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_identity.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_minimal.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_pipeline_only.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_v1.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_v2.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_v3.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_v4.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_v5.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_v6.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_stage_b_v7_rep8.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v7_rep16.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v7_rep64.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v7_rep128.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v7.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v8.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v8b.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v9.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v10.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v11.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v11b.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v12.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_stage_b_v13.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v14.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v16.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v17.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v18.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v19.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v20.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v22_bug1fix.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v22.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v23.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v24.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v25.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v26.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_stage_b_v27.py
Stage B: pipeline deadlock fixed, V MN-major applied, PV output garbage
2026-05-21 04:10:07 +00:00
test_step2_subtile_v2.py
wip: Step 2 gate/up pairing — SiLU validated, runtime conditionals blocked by CuTeDSL
2026-05-20 03:26:20 +00:00
test_step2_subtile.py
wip: Step 2 gate/up pairing — SiLU validated, runtime conditionals blocked by CuTeDSL
2026-05-20 03:26:20 +00:00
test_store_verify2.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_store_verify.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_tmem_addressing.py
Stage B: two MMAs + identity softmax — crash fixed, softmax output still wrong
2026-05-20 20:26:25 +00:00
test_tmem_copy_roundtrip.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_tmem_fp32_roundtrip.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_tmem_layout_diag.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_tmem_pure_fp32.py
Stage B: C-fragment vs A-fragment TMEM layout mismatch diagnosed
2026-05-21 00:12:47 +00:00
test_uniform_fp4.py
cleanup: move useful tests to tests/, nuke stale debug tests
2026-05-16 02:14:37 +00:00
test_v4_attention_b200.py
Add DeepSeek-V4 CSA/HCA attention pipeline test (not MLA)
2026-05-19 08:51:16 +00:00
test_vllm_codepaths_b200.py
Fix imports in vLLM codepaths test
2026-05-19 17:26:50 +00:00
test_warmup_gs.py
test: use runner's built-in warmup method
2026-05-17 08:24:27 +00:00
test_wo_a_bmm.py
Fix BF16 wo_a: per-group BMM instead of flat linear
2026-05-19 04:10:02 +00:00
test_wo_a.py
Fix test: cos_sin_cache on CUDA device
2026-05-19 02:37:50 +00:00