Files
nvfp4-megamoe-kernel/tests
biondizzle bb7ec341cb fix: D5b test uses reference attn_sum for normalization, correct D5 merge formula
- exp(LSE) != row_sum (it's row_sum * exp(max(S*scale)))
- Normalize using reference attn_sum (same as other tests)
- D5 merge uses normalized O + LSE: O = sum(exp(lse)*O_norm)/sum(exp(lse))
- Added 4-tile KV merge test (s_k=512)
2026-05-26 10:59:04 +00:00
..