Michael Goin fd0e377244 Support FP8 block quant for CompressedTensorsW8A16Fp8 (#33280) ...

Signed-off-by: mgoin <mgoin64@gmail.com>

2026-01-30 11:15:20 -05:00

..

attention

[Attention] Use has_flashinfer helper (#33177)

2026-01-27 18:33:17 +00:00

fla

[Bugfix][Kernel] Fix negative memory offset in GDN Triton kernel (#33326)

2026-01-29 10:40:11 -08:00

fused_moe

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

mamba

[Performance] Tune Mamba selective scan kernel for B200 (#32873)

2026-01-26 05:56:54 -08:00

pooler

Support bge-m3 sparse embeddings and colbert embeddings (#14526)

2026-01-22 23:52:57 +08:00

quantization

Support FP8 block quant for CompressedTensorsW8A16Fp8 (#33280)

2026-01-30 11:15:20 -05:00

rotary_embedding

[model] Add support for openPangu7B-VL (#32449)

2026-01-30 15:54:27 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[torch.compile] Compile CustomOp.forward_native for SiluAndMul and QuantFP8 to avoid raw torch ops inside opaque custom ops (#32806)

2026-01-22 19:52:26 -08:00

attention_layer_base.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

batch_invariant.py

Disable Cascade Attention for Batch Invariance (#32561)

2026-01-30 10:00:46 -05:00

conv.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00

kda.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

layernorm.py

[CI][Models] Add VLM Support for Sequence Classification Conversion (#32885)

2026-01-23 16:22:51 +08:00

lightning_attn.py

[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)

2025-11-21 11:53:09 -05:00

linear.py

Disable Cascade Attention for Batch Invariance (#32561)

2026-01-30 10:00:46 -05:00

logits_processor.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00

mla.py

[5/N][Attention] Finish eliminating vllm/attention folder (#32064)

2026-01-27 10:02:51 -05:00

resampler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sparse_attn_indexer.py

[ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287)

2026-01-21 23:16:30 +08:00

utils.py

Disable Cascade Attention for Batch Invariance (#32561)

2026-01-30 10:00:46 -05:00

vocab_parallel_embedding.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00