Wei Zhao 0be9516ea4 [Bug] Fix Trtllm Fp8 MoE Weight Shuffle Memory Fragamentation (#39054) ...

Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>

2026-04-07 08:04:08 -04:00

..

attention

[EASY] Drop duplicate KV-cache initialization (#38799)

2026-04-06 18:05:39 +00:00

fla

[Perf][GDN] Align TMA usage with upstream FLA (#38981)

2026-04-05 00:38:02 +08:00

fused_moe

[Kernels][MoE] Fix legacy_routing to use bitmatrix-based routing path (#38504)

2026-04-07 10:57:09 +08:00

mamba

[GDN] Eliminate GPU->CPU sync in prepare_chunk_indices during prefill (#38361)

2026-04-03 13:38:02 +00:00

pooler

[Perf] Optimize mean pooling using chunks and index_add, 5.9% E2E throughput improvement (#38559)

2026-04-01 03:54:58 +00:00

quantization

[Bug] Fix Trtllm Fp8 MoE Weight Shuffle Memory Fragamentation (#39054)

2026-04-07 08:04:08 -04:00

rotary_embedding

[New Model]: add support for telechat3 (#38510)

2026-04-03 08:26:22 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[XPU][1/N] Deprecate ipex and switch to vllm-xpu-kernels for xpu platform (#33379)

2026-02-02 22:46:10 -08:00

attention_layer_base.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

batch_invariant.py

[Bugfix] Fix AWQ models batch invariance issues (#38670)

2026-04-03 14:54:15 +00:00

conv.py

[Misc] Always use forward_mulmat for Conv3d on newer versions of torch. (#38487)

2026-03-30 05:39:41 +00:00

kda.py

[Kernel] Mamba support different layout for Conv state (#37416)

2026-04-03 01:50:09 +02:00

layernorm.py

[vLLM IR] rework gemma_rms_norm (#39014)

2026-04-07 01:37:00 -07:00

lightning_attn.py

[Bugfix] Use null block (0) for padded block table entries (#35431)

2026-03-30 14:02:51 -07:00

linear.py

[Quantization][Deprecation] Remove Petit NVFP4 (#32694)

2026-04-05 00:07:45 +00:00

logits_processor.py

[Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049)

2026-02-22 14:59:16 -08:00

mla.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer.py

[Bugfix][MLA] Add logits size budget to sparse indexer prefill chunking (#36178)

2026-04-01 00:15:53 -04:00

utils.py

[ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709)

2026-03-20 10:11:23 -05:00

vocab_parallel_embedding.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00