biondizzle
0 Followers · 0 Following
  • Joined on 2025-12-10
Repositories
25
 Projects Packages Public Activity Starred Repositories
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 19:15:29 +00:00
5ea3aa3406 Update GETTING_CUDAGRAPH_READY.md and CUDA_GRAPH_SYNC_INVENTORY.md
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 18:08:28 +00:00
80bb27f5bf CUDA graph: Fix gsa broadcast — contiguous for prefill, reshape for decode
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 17:53:49 +00:00
518a1d3f95 CUDA graph: Fix MoE scatter_add_ index dtype + fix second bincount
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 17:39:21 +00:00
f13a81d48b CUDA graph: Fix per-call allocations in grouped_linear and quantize
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 17:37:06 +00:00
84655d066a CUDA graph: Fix MoE bincount and per-call allocations (Hazard #4)
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 17:20:45 +00:00
df05289d6f CUDA graph: Fix remaining sync violations from B200 detector run 2
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 17:02:37 +00:00
e07d79868f CUDA graph: Fix _assemble_scales_single_group swizzle size
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 16:52:31 +00:00
0ca7bed0e1 CUDA graph: Fix sync violations found by B200 detector
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 16:38:36 +00:00
46a3a51832 CUDA graph: Fix per-step allocations in decode loop
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 16:37:23 +00:00
a9ea30353c CUDA graph: Fix sync violations (Category 1-2)
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 16:34:35 +00:00
caac8ae108 Fix syntax error: 'is not not None' -> 'is not None'
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 16:34:18 +00:00
ba68212fa7 Add CUDA graph readiness detector (Section A of GETTING_CUDAGRAPH_READY.md)
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 15:52:02 +00:00
ca5bc814d5 Fix compressor: do not add positional bias to KV content
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 15:45:22 +00:00
4fe73fe713 auto: pre-test commit
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 14:57:53 +00:00
f577ed97f4 Fix: Use PyTorch dequant_nvfp4 for weight dequantization (compressor/indexer/router gate)
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 14:48:54 +00:00
1121cd7b47 Add CUDA_LAUNCH_BLOCKING=1 to catch async errors
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 14:38:26 +00:00
f3bb0ca08c Fix dequant gsa: use ws2 only, NOT input_scale * ws2
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 14:27:01 +00:00
470e65fb19 Fix dequant gsb: input_scale * ws2, not 1.0 * ws2
biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel 2026-06-03 14:19:44 +00:00
2dd16d5789 Switch compressor + indexer weights_proj to BF16 F.linear