vllm/vllm/model_executor/layers/fused_moe at 316c8492bf4d5fca8f9f8ea6f8ef1d76a0cb940f - vllm

configs

chore: add RTX_PRO_6000 GLM4.6-FP8 kernel tuning (#29240 )

2025-11-22 08:42:48 -08:00

__init__.py

[Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064 )

2025-11-11 07:29:02 -07:00

all2all_utils.py

[Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449 )

2025-11-19 13:46:24 +01:00

batched_deep_gemm_moe.py

[Performance][DeepGEMM] Estimate expected_m (#28694 )

2025-11-15 13:52:14 +08:00

batched_triton_or_deep_gemm_moe.py

[Feature] Migrate DeepGEMM API from get_m_alignment_for_contiguous_layout to get_mk_alignment_for_contiguous_layout (#26935 )

2025-10-16 16:46:48 -04:00

config.py

Handle triton kernel import exception (#29062 )

2025-11-22 10:07:50 +00:00

cpu_fused_moe.py

[CPU] Refactor CPU WNA16 (#28826 )

2025-11-19 10:32:00 +08:00

cutlass_moe.py

[Bug] Fix DeepSeek-V2.5-1210-FP8 issue (#27267 )

2025-10-22 11:00:10 -04:00

deep_gemm_moe.py

[BugFix] Fix DeepGEMM over-allocating workspace (#28254 )

2025-11-10 17:01:17 -05:00

deep_gemm_utils.py

[Chore]:Extract math and argparse utilities to separate modules (#27188 )

2025-10-26 04:03:32 -07:00

deepep_ht_prepare_finalize.py

[Bug] Fix DBO IMA issue for DeepEPHT (#27666 )

2025-10-29 16:28:27 -04:00

deepep_ll_prepare_finalize.py

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990 )

2025-11-19 13:29:06 -08:00

flashinfer_cutedsl_moe.py

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990 )

2025-11-19 13:29:06 -08:00

flashinfer_cutlass_moe.py

Feature: Support Relu2 in FusedMoE fp8 cutlass path (#27261 )

2025-11-16 13:39:44 -05:00

flashinfer_cutlass_prepare_finalize.py

[Kernels] Enable FlashInfer FP8 Blockscale on SM90 (for TEP DSR1) (#27134 )

2025-11-14 08:02:44 -08:00

flashinfer_trtllm_moe.py

[Performance] Support FP8 flashinfer TRTLLM MOE on Qwen3 and Qwen-3next (#27492 )

2025-11-10 12:34:57 -05:00

fused_batched_moe.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

fused_marlin_moe.py

Support DeepEP for Kimi-k2-thinking through enabling gemm selection for compressed-tensor marlin wna16 (#28574 )

2025-11-12 21:40:45 -08:00

fused_moe_method_base.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

fused_moe_modular_method.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

fused_moe.py

[Log] Optimize startup log (#28948 )

2025-11-21 08:46:20 -08:00

gpt_oss_triton_kernels_moe.py

[Chore] Separate out optional dependency checks from vllm.utils (#27207 )

2025-10-22 10:44:21 -04:00

layer.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

modular_kernel.py

[BugFix] Make sure to allocate worst case MoE workspace during profile run in the DP + EP case (#27426 )

2025-11-21 11:41:52 -08:00

moe_align_block_size.py

[Chore]:Extract math and argparse utilities to separate modules (#27188 )

2025-10-26 04:03:32 -07:00

moe_pallas.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

moe_permute_unpermute.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

moe_torch_iterative.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

pplx_prepare_finalize.py

[Chore]:Extract math and argparse utilities to separate modules (#27188 )

2025-10-26 04:03:32 -07:00

prepare_finalize.py

[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput improvement and 3.6% TTFT improvement (#28879 )

2025-11-20 18:41:49 -07:00

rocm_aiter_fused_moe.py

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490 )

2025-11-10 08:20:53 -08:00

routing_simulator.py

[Bugfix] Fix MoE Routing Simulation (#28002 )

2025-11-03 22:26:49 +00:00

shared_fused_moe.py

[Bugfix] Disable shared expert overlap if Marlin MoE is used (#28410 )

2025-11-11 23:16:12 +00:00

topk_weight_and_reduce.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

triton_deep_gemm_moe.py

[Feature] Migrate DeepGEMM API from get_m_alignment_for_contiguous_layout to get_mk_alignment_for_contiguous_layout (#26935 )

2025-10-16 16:46:48 -04:00

trtllm_moe.py

[BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904 )

2025-11-04 15:56:21 +08:00

unquantized_fused_moe_method.py

[MoE][Refactor] Make select_experts a non-static method (#29067 )

2025-11-24 13:38:04 -05:00

utils.py

[Chore]:Extract math and argparse utilities to separate modules (#27188 )

2025-10-26 04:03:32 -07:00