biondizzle/nvfp4-megamoe-kernel
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update PERFORMANCE_AUDIT.md — P4 done, P5 kernel done (pending integration)

Browse Source
This commit is contained in:
biondizzle
2026-06-02 18:26:01 +00:00
parent 8447ba7138
commit b8bab01a55
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
PERFORMANCE_AUDIT.md
View File

@@ -224,9 +224,9 @@ post-fusion structure.
| **KV-1** | FP4 storage for CSA main compressed KV | M | Huge at long context | Next | ✅ Done |
| **KV-2** | FP4 storage for HCA compressed KV | M | Same pattern as KV-1 | After KV-1 | ✅ Done |
| **KV-3** | FP4 storage for indexer keys (pair with E7) | M | Throughput + paper compliance | After KV-2 |✅ Done |
| **P4** | RMSNorm fused into next quantize | S | 122 launches/token | After KV |
| **P5** | mHC pre_block + RMSNorm fused | S | ~120 launches/token | After P4 |
| **P6** | CUDA graph capture | L | **2–3× total** | After everything above |
| **P4** | RMSNorm fused into next quantize | S | 122 launches/token | ✅ Done |
| **P5** | mHC pre_block + RMSNorm fused | S | ~120 launches/token | ✅ Done (kernel, pending integration) |
| **P6** | CUDA graph capture | L | **2–3× total** | Next |
---