Update README with final kernel status

This commit is contained in:
2026-05-20 04:39:57 +00:00
parent fffb2144ae
commit efa0a156a0

View File

@@ -134,11 +134,13 @@ CuTeDSL **does** support runtime conditionals on register tensors — the rule i
| Step | What | Status |
|------|------|--------|
| 1 | Wire fused kernel into pipeline (skip BF16 GMEM round-trip) | 🔄 In progress |
| 2 | NVFP4 quantize in epilogue (per-16-element amax, FP8 SF, FP4 pack) | 🔨 Next |
| 3 | FP4 TMA store to padded L2 buffer | Not started |
| 4 | FP8 SF TMA store through blockscaled layout | Not started |
| 5 | End-to-end test with fused pipeline | Not started |
| 1 | Wire fused kernel into pipeline | ✅ Done |
| 2 | Custom CUDA de-interleave + quantize kernel (4.3x faster) | ✅ Done |
| 3 | In-epilogue NVFP4 quantize (replace BF16 TMA with FP4 TMA) | 🔨 Future optimization |
**Current pipeline:** Fused SwiGLU kernel → BF16 TMA store → Custom CUDA quantize → L2 GEMM
**Cosine:** 0.988 (non-fused) / 0.988 (fused) vs BF16 reference
**Quantize speedup:** 4.3x (0.043ms vs 0.184ms), saves ~8.5ms over 60 MoE layers
---