EdalatiAli e5b807607c [Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448) ...

Signed-off-by: EdalatiAli <aliedalati@cohere.com>

2026-03-16 18:07:39 -04:00

..

attention

[Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090)

2026-03-16 19:03:10 +02:00

fla

[Perf] add packed recurrent fast path for decode (#36596)

2026-03-12 04:01:57 -07:00

fused_moe

[Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448)

2026-03-16 18:07:39 -04:00

mamba

replace with torch.cuda.device with with torch.accelerator.device_index (#36144)

2026-03-11 23:12:57 -07:00

pooler

fix bugs when token_classify & classify run concurrently (#36614)

2026-03-10 20:16:34 -07:00

quantization

[Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448)

2026-03-16 18:07:39 -04:00

rotary_embedding

[XPU] Add deepseek_scaling_rope fused kernel (#36612)

2026-03-16 12:35:08 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[XPU][1/N] Deprecate ipex and switch to vllm-xpu-kernels for xpu platform (#33379)

2026-02-02 22:46:10 -08:00

attention_layer_base.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

batch_invariant.py

[Platform] Add current_platform.num_compute_units interface (#35042)

2026-02-24 22:22:49 -08:00

conv.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00

kda.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

layernorm.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

lightning_attn.py

[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)

2025-11-21 11:53:09 -05:00

linear.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

logits_processor.py

[Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049)

2026-02-22 14:59:16 -08:00

mla.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer.py

Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230)

2026-03-11 19:19:15 +08:00

utils.py

In-Tree AMD Zen CPU Backend via zentorch [1/N] (#35970)

2026-03-15 23:35:35 +00:00

vocab_parallel_embedding.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00