Benjamin Chislett 8332078cfd [Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize (#39315) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2026-04-08 20:36:33 -04:00

..

attention

[Attention][V0 Deprecation] Deprecate accept output buffer (#39125)

2026-04-07 17:14:58 -04:00

fla

[CI][AMD][BugFix][Kernel] Cast induction variable to int64 on MI350 for chunk_gated_delta_rule_fwd_kernel_h_blockdim64 to avoid illegal memory access (#39087)

2026-04-08 16:57:18 +08:00

fused_moe

[MoE] Move DEEP_GEMM into experts/ subdirectory (#39005)

2026-04-08 19:23:08 +00:00

mamba

[GDN] Eliminate GPU->CPU sync in prepare_chunk_indices during prefill (#38361)

2026-04-03 13:38:02 +00:00

pooler

[Perf] Optimize mean pooling using chunks and index_add, 5.9% E2E throughput improvement (#38559)

2026-04-01 03:54:58 +00:00

quantization

[Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize (#39315)

2026-04-08 20:36:33 -04:00

rotary_embedding

[New Model]: add support for telechat3 (#38510)

2026-04-03 08:26:22 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[XPU][1/N] Deprecate ipex and switch to vllm-xpu-kernels for xpu platform (#33379)

2026-02-02 22:46:10 -08:00

attention_layer_base.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

batch_invariant.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

conv.py

[Misc] Always use forward_mulmat for Conv3d on newer versions of torch. (#38487)

2026-03-30 05:39:41 +00:00

kda.py

[Kernel] Mamba support different layout for Conv state (#37416)

2026-04-03 01:50:09 +02:00

layernorm.py

[vLLM IR] rework gemma_rms_norm (#39014)

2026-04-07 01:37:00 -07:00

lightning_attn.py

[Bugfix] Use null block (0) for padded block table entries (#35431)

2026-03-30 14:02:51 -07:00

linear.py

[Bugfix][Quantization] Fix PerTensorScale loading with tuple shard_id in MergedColumnParallelLinear (#38517)

2026-04-07 11:16:26 -04:00

logits_processor.py

[Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049)

2026-02-22 14:59:16 -08:00

mla.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer.py

[Perf][Kernel] Persistent TopK scheduler: unified CUDAGraph-safe kernel with dynamic per-row dispatch - DeepSeek-V3.2 DSA decode (#37421)

2026-04-08 13:35:57 -04:00

utils.py

[ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709)

2026-03-20 10:11:23 -05:00

vocab_parallel_embedding.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00