Files
nvfp4-megamoe-kernel/dsv4
biondizzle 89510601f5 Revert compressor pos bias fix + SwiGLU clamp ordering from commit 3320abf
These changes were made based on CORRECTNESS_FIX_ATTEMPTS.md but the
PyTorch reference (which works correctly) doesn't have them. Reverting
to match the reference behavior:
- Compressor: position bias added to BOTH gate logits AND KV content
- SwiGLU: clamp after silu(gate), not before
2026-06-03 13:57:16 +00:00
..