Robert Shaw 28a82bb5e6 [Bugfix] Fix Stream Sync for Shared Expert Overlap (#28430) ...

Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
(cherry picked from commit e605e8e323)

2025-11-15 21:44:19 -08:00

..

configs

[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for Qwen3 omni for MI308X (#28373)

2025-11-10 04:53:40 +00:00

__init__.py

[torch.compile] Unwrap fused_marlin_moe custom op (#26739)

2025-10-14 02:22:16 +00:00

batched_deep_gemm_moe.py

[Bugfix] Fix persistent_masked_m_silu_mul_quant tests (#28366)

2025-11-10 09:21:52 -08:00

batched_triton_or_deep_gemm_moe.py

[Feature] Migrate DeepGEMM API from get_m_alignment_for_contiguous_layout to get_mk_alignment_for_contiguous_layout (#26935)

2025-10-16 16:46:48 -04:00

config.py

[Performance] Support FP8 flashinfer TRTLLM MOE on Qwen3 and Qwen-3next (#27492)

2025-11-10 12:34:57 -05:00

cpu_fused_moe.py

[CPU]Improve cpu fused moe perf (#27244)

2025-11-06 11:04:18 +00:00

cutlass_moe.py

[Bug] Fix DeepSeek-V2.5-1210-FP8 issue (#27267)

2025-10-22 11:00:10 -04:00

deep_gemm_moe.py

[BugFix] Fix DeepGEMM over-allocating workspace (#28254)

2025-11-10 17:01:17 -05:00

deep_gemm_utils.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

deepep_ht_prepare_finalize.py

[Bug] Fix DBO IMA issue for DeepEPHT (#27666)

2025-10-29 16:28:27 -04:00

deepep_ll_prepare_finalize.py

[Misc] Rev DeepEP (#27122)

2025-10-18 14:54:29 +08:00

flashinfer_cutlass_moe.py

Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223)

2025-10-31 17:54:29 +00:00

flashinfer_cutlass_prepare_finalize.py

[flashinfer] fix FI all2all with FI cutlass moe (#28166)

2025-11-06 05:52:16 +00:00

flashinfer_trtllm_moe.py

[Performance] Support FP8 flashinfer TRTLLM MOE on Qwen3 and Qwen-3next (#27492)

2025-11-10 12:34:57 -05:00

fused_batched_moe.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

fused_marlin_moe.py

[Feature][Kernel]FusedMoE LoRA (#21229)

2025-10-21 03:01:37 +00:00

fused_moe.py

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

gpt_oss_triton_kernels_moe.py

[Chore] Separate out optional dependency checks from vllm.utils (#27207)

2025-10-22 10:44:21 -04:00

layer.py

[Bugfix] Fix Stream Sync for Shared Expert Overlap (#28430)

2025-11-15 21:44:19 -08:00

modular_kernel.py

[Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123)

2025-11-04 21:59:45 +08:00

moe_align_block_size.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

moe_pallas.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

moe_permute_unpermute.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

moe_torch_iterative.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

pplx_prepare_finalize.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00

prepare_finalize.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

rocm_aiter_fused_moe.py

[RFC][ROCm][AITER] Keep all AITER kernels in _aiter_ops class like _custom_ops and _ipex_ops (#24490)

2025-11-10 08:20:53 -08:00

routing_simulator.py

[Bugfix] Fix MoE Routing Simulation (#28002)

2025-11-03 22:26:49 +00:00

shared_fused_moe.py

[Bugfix][EPLB] Disabled shared expert overlap when EPLB is enabled (#28377)

2025-11-10 20:39:19 +00:00

topk_weight_and_reduce.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

triton_deep_gemm_moe.py

[Feature] Migrate DeepGEMM API from get_m_alignment_for_contiguous_layout to get_mk_alignment_for_contiguous_layout (#26935)

2025-10-16 16:46:48 -04:00

trtllm_moe.py

[BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904)

2025-11-04 15:56:21 +08:00

utils.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00