biondizzle

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 03:46:38 +00:00

09384a637a Fix constexpr issues in prefill debug test

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 03:46:19 +00:00

d3dc8cf901 Add prefill T=2 debug CUDA test with intermediate value printing

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 03:22:52 +00:00

223c22488f Simplify prefill PV read: use decode kernel's exact pattern

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 03:05:28 +00:00

2bf5e74e61 Add prefill debug test: compare T=1 decode vs prefill kernel step by step

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 03:01:06 +00:00

eb69c3bfb9 CRITICAL FIX: add missing tb base in QK TMEM read address

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:59:21 +00:00

99b6de316b Fix prefill kernel: add missing tb base in PV TMEM read, fix ACCUMULATE for per-row PV

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:55:03 +00:00

9034f67b0f Fix prefill kernel: read ALL n_sub PV results (was only n_sub=0)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:50:28 +00:00

a4ef6c3454 Add B1 mixed FP8 prefill FMHA kernel (T>1 support)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:47:49 +00:00

1f757151ef Fix router gate BF16 quantize path for production FMHA test

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:38:17 +00:00

07168357cc Fix o_a_proj weight loading: add BF16 fallback for grouped linear

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:31:12 +00:00

27d8d80a40 Fix missing DEVICE constant in production FMHA test

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:26:40 +00:00

26a817c2f2 Fix production FMHA layer test: compare raw FMHA vs SDPA on production gathered KV

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:22:36 +00:00

ba67e055f7 Add production FMHA layer comparison test

biondizzle pushed tag v-b1-b2-done-20260603 to biondizzle/nvfp4-megamoe-kernel

2026-06-03 02:14:54 +00:00

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 01:53:00 +00:00

af58f2c5b2 Add B1 weight/format verification at L0 in single_shot

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 01:51:00 +00:00

8df5de5477 Update B1 docs with test results and bug fix

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 01:50:23 +00:00

3e3b352e7e Update FINAL_STRETCH.md: B1 and B2 marked DONE with test results and bug fixes

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 01:49:40 +00:00

84a02f8995 Remove debug test files, keep production B1/B2 unit tests

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 01:42:48 +00:00

6fa9ad7852 B2 indexer: adopt TMEM warp-to-row mapping fix

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 01:12:12 +00:00

6c92ff91f3 B2 indexer: temporary heads 0-31 only while figuring out TMEM row 32-63 layout