Update README with final kernel status
This commit is contained in:
12
README.md
12
README.md
@@ -134,11 +134,13 @@ CuTeDSL **does** support runtime conditionals on register tensors — the rule i
|
||||
|
||||
| Step | What | Status |
|
||||
|------|------|--------|
|
||||
| 1 | Wire fused kernel into pipeline (skip BF16 GMEM round-trip) | 🔄 In progress |
|
||||
| 2 | NVFP4 quantize in epilogue (per-16-element amax, FP8 SF, FP4 pack) | 🔨 Next |
|
||||
| 3 | FP4 TMA store to padded L2 buffer | Not started |
|
||||
| 4 | FP8 SF TMA store through blockscaled layout | Not started |
|
||||
| 5 | End-to-end test with fused pipeline | Not started |
|
||||
| 1 | Wire fused kernel into pipeline | ✅ Done |
|
||||
| 2 | Custom CUDA de-interleave + quantize kernel (4.3x faster) | ✅ Done |
|
||||
| 3 | In-epilogue NVFP4 quantize (replace BF16 TMA with FP4 TMA) | 🔨 Future optimization |
|
||||
|
||||
**Current pipeline:** Fused SwiGLU kernel → BF16 TMA store → Custom CUDA quantize → L2 GEMM
|
||||
**Cosine:** 0.988 (non-fused) / 0.988 (fused) vs BF16 reference
|
||||
**Quantize speedup:** 4.3x (0.043ms vs 0.184ms), saves ~8.5ms over 60 MoE layers
|
||||
|
||||
---
|
||||
|
||||
|
||||
Reference in New Issue
Block a user