Kaixi Hou 6d0734c562 [NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645) ...

Signed-off-by: kaixih <kaixih@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

2025-07-19 02:33:01 -07:00

..

fused_moe

[NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645)

2025-07-19 02:33:01 -07:00

mamba

[BugFix] fix 3 issues: (1) using metadata for causal-conv1d, (2) indexing overflow in v1 vLLM, and (3) init_states in v0 (#20838)

2025-07-15 16:08:26 -04:00

quantization

[NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645)

2025-07-19 02:33:01 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

Gemma3n (Text-only) (#20134)

2025-06-27 07:16:26 +00:00

layernorm.py

[V0 deprecation] Remove V0 HPU backend (#21131)

2025-07-17 16:37:36 -07:00

lightning_attn.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

linear.py

[Bugfix] weight loading use correct tp_group with patch_tensor_parallel_group (#21024)

2025-07-16 19:36:36 -07:00

logits_processor.py

[Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702)

2025-07-12 06:02:10 -07:00

pooler.py

[Core] Set pooling params based on task and model (#21128)

2025-07-18 05:41:17 -07:00

resampler.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

rotary_embedding.py

[V0 deprecation] Remove V0 HPU backend (#21131)

2025-07-17 16:37:36 -07:00

sampler.py

[V0 Deprecation] Remove V0 Spec Decode workers (#21152)

2025-07-18 21:47:50 -07:00

utils.py

[CPU] Update custom ops for the CPU backend (#20255)

2025-07-01 07:25:03 +00:00

vocab_parallel_embedding.py

[V0 deprecation] Remove V0 HPU backend (#21131)

2025-07-17 16:37:36 -07:00