biondizzle/nvfp4-megamoe-kernel
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,399 Commits 1 Branch 17 Tags
ac213bdee886b677289e4fbc5a8bf1cd1f7dff2f
Commit Graph

2 Commits

Author SHA1 Message Date
biondizzle
baee36e728 Fix dtype mismatch in validate_layer: cast flat to float before F.linear 2026-05-31 20:23:18 +00:00
biondizzle
46c4ef2cf5 Add per-layer validation test (tests/validate_layer.py) 
Compares forward_layer output with step-by-step PyTorch reference
to identify where residual blowup originates. Uses our own NVFP4
dequant — no HF dependency.
 2026-05-31 20:22:13 +00:00