biondizzle 31ebe4f2db Wire NVFP4 fused router kernel into e2e single-shot pipeline ...

- Add dense_router_dispatch_nvfp4_fused() in dense_router_decode.py:
  single-kernel NVFP4 blockscaled GEMM + fused router epilogue
- Router.load_nvfp4_fused_gate(): stores raw NVFP4 tensors for fused path
- Router._run_dense_impl() dispatch priority: fused > 2-kernel > BF16
- single_shot_inference.py: loads raw NVFP4 gate weights for fused kernel
  instead of building Nvfp4Linear (which was the 2-kernel path)
- Fix selection sort bug in nvfp4_fused_router_kernel.py: pass 0 was
  missing t_s/t_i/t_a temp save before swap, causing undefined vars
- Export dense_router_dispatch_nvfp4_fused from __init__.py

2026-06-01 09:47:48 +00:00

..

__init__.py

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

attention.py

E2/E3: compressor bridge, indexer bridge, flush pipeline wiring

2026-05-30 21:16:54 +00:00

embedding.py

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

ffn.py

Layer dispatch: config, schedule, attention/FFN sub-blocks, TransformerLayer

2026-05-21 23:11:09 +00:00

grouped_linear.py

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

linear.py

fix: transpose checkpoint weights before make_b_k_major in Nvfp4Linear/SharedExpert

2026-06-01 00:30:37 +00:00

mhc.py

Add --no-thinking mode to skip thinking tokens and use second-best

2026-05-31 19:24:21 +00:00

moe.py

fix: convert uint8 checkpoint weights to float4_e2m1fn_x2 for CuTeDSL GEMM

2026-06-01 00:18:34 +00:00

norm.py

Fix layer construction: match existing API signatures, add RMSNorm impl

2026-05-21 23:31:58 +00:00

router.py

Wire NVFP4 fused router kernel into e2e single-shot pipeline

2026-06-01 09:47:48 +00:00

shared_expert.py

diag: NaN detection in shared expert gate/up split

2026-06-01 04:01:46 +00:00