Michael Goin 09e4576f65 [Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320) ...

Signed-off-by: mgoin <mgoin64@gmail.com>

2026-03-17 18:12:04 -04:00

..

configs

[ROCm] add tuned moe_wna16_triton kernel configs for CDNA4 (#35093)

2026-03-11 19:00:08 +00:00

experts

[Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448)

2026-03-16 18:07:39 -04:00

oracle

[Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448)

2026-03-16 18:07:39 -04:00

prepare_finalize

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

router

[ROCM] Optimize the fused_topk_bias to use aiter instead of fallback torch ops. (#36253)

2026-03-09 11:30:35 -05:00

runner

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

__init__.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

activation.py

[Refactor] Replace activation: str with MoEActivation enum (#33843)

2026-02-11 17:29:32 -08:00

all2all_utils.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

batched_deep_gemm_moe.py

[Feature]: Remove Chunking From FusedMoE (#34086)

2026-03-12 14:24:38 -04:00

config.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

cpu_fused_moe.py

[Torch 2.11] Guard torch._C._cpu attribute checks for forward compatibility (#35673)

2026-03-17 18:47:59 +00:00

cutlass_moe.py

[Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320)

2026-03-17 18:12:04 -04:00

deep_gemm_moe.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

deep_gemm_utils.py

[Bugfix] ep_scatter kernel store-load race condition (#34991)

2026-03-13 01:07:59 +00:00

deepep_ht_prepare_finalize.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

deepep_ll_prepare_finalize.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

fallback.py

[Feature]: Remove Chunking From FusedMoE (#34086)

2026-03-12 14:24:38 -04:00

flashinfer_cutedsl_moe.py

Fix eplb nvfp4 experts hook (#37217)

2026-03-16 22:03:54 +00:00

flashinfer_cutlass_moe.py

Fix eplb nvfp4 experts hook (#37217)

2026-03-16 22:03:54 +00:00

flashinfer_nvlink_one_sided_prepare_finalize.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

flashinfer_nvlink_two_sided_prepare_finalize.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

flashinfer_trtllm_moe.py

[Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE (#36146)

2026-03-05 09:49:05 -08:00

fused_batched_moe.py

[Feature]: Remove Chunking From FusedMoE (#34086)

2026-03-12 14:24:38 -04:00

fused_marlin_moe.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

fused_moe_method_base.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

fused_moe_modular_method.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

fused_moe.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

gpt_oss_triton_kernels_moe.py

[Feature]: Remove Chunking From FusedMoE (#34086)

2026-03-12 14:24:38 -04:00

layer.py

Fix eplb nvfp4 experts hook (#37217)

2026-03-16 22:03:54 +00:00

modular_kernel.py

Fix eplb nvfp4 experts hook (#37217)

2026-03-16 22:03:54 +00:00

moe_align_block_size.py

[Kernel][MoE] optimize moe_align_block_size (#29642)

2025-12-07 01:58:47 -08:00

moe_permute_unpermute.py

[Refactor] Remove align block size logic in moe_permute (#33449)

2026-02-06 10:57:06 -08:00

mori_prepare_finalize.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

nixl_ep_prepare_finalize.py

[2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627)

2026-03-13 09:25:33 -04:00

rocm_aiter_fused_moe.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

routed_experts_capturer.py

[Bugfix] fix device_name for routing replay (#34336)

2026-02-26 12:18:38 +00:00

shared_fused_moe.py

[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)

2026-02-10 19:51:07 -05:00

topk_weight_and_reduce.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

triton_cutlass_moe.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

triton_deep_gemm_moe.py

[MoE Refactor] Create MK for TRTLLM Kernels (#32564)

2026-03-03 10:39:50 -08:00

trtllm_moe.py

[Feature]: Remove Chunking From FusedMoE (#34086)

2026-03-12 14:24:38 -04:00

unquantized_fused_moe_method.py

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

utils.py

[Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448)

2026-03-16 18:07:39 -04:00

xpu_fused_moe.py

[Feature]: Remove Chunking From FusedMoE (#34086)

2026-03-12 14:24:38 -04:00

zero_expert_fused_moe.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00