biondizzle

0 Followers · 0 Following

• Joined on 2025-12-10

Repositories

25

Projects Packages Public Activity Starred Repositories

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 06:10:34 +00:00

262f844e2e PART A: add detailed blowup diagnostics — capture mHC intermediate values when |X| > 1e6

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 05:41:34 +00:00

6459fbca9a fix: import forward_attention

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 05:33:25 +00:00

91dfac34d8 PART A: simplified to production-only diagnostics — track per-layer |X| during prefill and decode, detect blowup early

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 05:23:02 +00:00

d99503732d fix: add BF16 gate weight fallback for dense routers (missing from test)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 05:15:54 +00:00

801bfc9a83 add router mode debug print

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 05:06:42 +00:00

b385ecc05e PART A: decode diagnostics test — production vs reference per-layer X comparison at decode step

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:57:40 +00:00

d518fcb82a test: correct sink bias reference — denominator-only, no V contribution

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:53:58 +00:00

9574a9dc2e test: add sink bias to reference SDPA in decode FMHA comparison

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:50:24 +00:00

9a9b347b2b test: add per-head magnitude ratio diagnostics to decode FMHA test

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:47:03 +00:00

f5fa20c581 fix: syntax error — missing closing paren in indexer.forward call

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:46:26 +00:00

693975ec92 fix: device mismatches in decode FMHA test — dec_pos must be on per-layer GPU

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:39:16 +00:00

e1d96c509d test: decode FMHA layer comparison — checks FMHA accuracy during decode step

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:34:33 +00:00

1ebe7f0dde Add PART_A_NEXT_SESSION.md: clues for decode degeneration debugging

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:20:38 +00:00

d8306be3f2 Fix PART A test: proper FP8 quantization and MQA reference

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:18:26 +00:00

4126909dfb Simplify PART A test: compressor + FMHA at production scale

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:15:43 +00:00

8c54cfa748 Fix KVCache init in PART A test

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 04:13:54 +00:00

04cf8ca848 Add PART A diagnostic tests: compressor + KV cache + FMHA at production scale

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 03:50:00 +00:00

75288bd12f Wire prefill FMHA into production.py and single_shot

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 03:48:19 +00:00

5417f65b08 CRITICAL FIX: Add T-dimension strides to prefill FMHA kernel

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 03:47:02 +00:00

dd1cbe1faa Fix smem size for prefill debug test