biondizzle

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-04 01:03:38 +00:00

55def5eef9 Restore A/B split + gsa scalar fix (error is pre-existing, not regression)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-04 00:53:12 +00:00

59eccd04ab REVERT: test if cudaErrorInvalidValue is pre-existing or regression

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-04 00:41:36 +00:00

5e3ced0b60 DEBUG: isolate which kernel causes cudaErrorInvalidValue in SE L2 path

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-04 00:30:33 +00:00

b314fde9b7 Fix gsa copy_ cudaErrorInvalidValue: replace view-based copy_ with scalar assignment

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-04 00:15:40 +00:00

993bb345d1 DEBUG: fix VERBOSE reference in shared_expert, always print L2 gsa debug

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-04 00:05:10 +00:00

f0f87df906 DEBUG: add sync + shape prints to shared_expert L2 gsa copy

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 23:53:17 +00:00

1d6610c46d CUDA graph A/B split: eager-break-at-attention architecture

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 23:41:43 +00:00

800e974d20 Update CUDA_GRAPH_SYNC_INVENTORY.md with session 2 progress

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 23:17:54 +00:00

a468f72a0e CUDA graph: Pre-allocate L1 GEMM output buffers in MoE and SharedExpert

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 22:56:22 +00:00

56b816a54f CUDA graph: Use per-GPU position/token buffers for graph capture

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 22:26:51 +00:00

f57de06eb5 Fix grouped_linear GEMM output buffer shape and extraction

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 22:04:21 +00:00

92225b07e7 CUDA graph: Simplify to single-graph-per-layer capture (revert A/B split)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 22:02:03 +00:00

b32713c302 grouped_linear: Pre-allocate output buffer for grouped GEMM (CUDA graph capture)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 21:45:18 +00:00

676fad064f Fix: Add out= parameter to run_fused_swiglu_grouped_gemm signature

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 21:30:26 +00:00

188ecae47f CUDA graph: Eliminate per-step allocations in graph-captured code paths

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 21:09:15 +00:00

91c370360a Fix CuTeDSL from_dlpack device mismatch in CUDA graph capture (v3)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 20:54:21 +00:00

5c94dbbc37 Fix CuTeDSL from_dlpack device mismatch in CUDA graph capture (v2)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 20:34:27 +00:00

87b6c9932b Fix CuTeDSL from_dlpack device mismatch inside CUDA graph capture

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 19:49:56 +00:00

2661cebe9a Fix warmup_gsa: handle multi-element _gsa_buf (Nvfp4GroupedLinear per-group gsa)

biondizzle pushed to master at biondizzle/nvfp4-megamoe-kernel

2026-06-03 19:24:30 +00:00

486f74d900 CUDA graph: Implement eager-break-at-attention decoder with sub-graph A/B split