Sage Moore 567939953b [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

2025-09-16 12:21:48 -04:00

..

mla

[Bug] Fix is_flashmla_supported Check Error (#24774)

2025-09-15 20:10:55 -06:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

cpu_attn.py

[Kernel] [CPU] refactor cpu_attn.py:_run_sdpa_forward for better memory access (#24701)

2025-09-12 19:23:07 +08:00

flash_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

flashinfer.py

[flashinfer] [kernel] support for fp8 kv cache for trtllm prefill attention (#24197)

2025-09-11 14:20:09 -07:00

flex_attention.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

gdn_attn.py

[Qwen3Next] Fixes the cuda graph capture conditions under large batch sizes (#24660) (#24667)

2025-09-12 22:31:32 +00:00

linear_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

mamba1_attn.py

[Attention] FlashAttn MLA (#14258)

2025-09-04 02:47:59 -07:00

mamba2_attn.py

[Bugfix] Fix mamba2 prefill chunking (#23279)

2025-09-08 11:42:41 +00:00

mamba_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

pallas.py

[Docs] Fix warnings in mkdocs build (continued) (#23743)

2025-08-27 17:17:29 +00:00

rocm_aiter_fa.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

short_conv_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

tree_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

triton_attn.py

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767)

2025-09-10 13:59:55 -07:00

utils.py

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693)

2025-09-16 12:21:48 -04:00

xformers.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00