Matthew Bonanni 7ba32aa60b [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) ...

Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>

2025-09-12 15:45:53 -06:00

..

mla

[Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705)

2025-09-12 15:45:53 -06:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

cpu_attn.py

[Kernel] [CPU] refactor cpu_attn.py:_run_sdpa_forward for better memory access (#24701)

2025-09-12 19:23:07 +08:00

flash_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

flashinfer.py

[flashinfer] [kernel] support for fp8 kv cache for trtllm prefill attention (#24197)

2025-09-11 14:20:09 -07:00

flex_attention.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

gdn_attn.py

Add the support for the qwen3 next model (a hybrid attention model). (#24526)

2025-09-11 15:32:09 +08:00

linear_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

mamba1_attn.py

[Attention] FlashAttn MLA (#14258)

2025-09-04 02:47:59 -07:00

mamba2_attn.py

[Bugfix] Fix mamba2 prefill chunking (#23279)

2025-09-08 11:42:41 +00:00

mamba_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

pallas.py

[Docs] Fix warnings in mkdocs build (continued) (#23743)

2025-08-27 17:17:29 +00:00

rocm_aiter_fa.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

short_conv_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

tree_attn.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

triton_attn.py

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767)

2025-09-10 13:59:55 -07:00

utils.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

xformers.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00