Ayush Satyam 5c4b6e66fe [Attention] Unify mamba and attention backend selection (#23171) ...

Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>

2025-08-25 09:09:36 +00:00

..

mla

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

cpu_attn.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

flash_attn.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

flashinfer.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

flex_attention.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

linear_attn.py

[V1] [Hybrid] Support Minimax-Text-01 in V1 (#22151)

2025-08-08 23:08:48 -07:00

mamba1_attn.py

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035)

2025-08-20 20:08:51 -07:00

mamba2_attn.py

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035)

2025-08-20 20:08:51 -07:00

mamba_attn.py

[V1][Mamba1] - Full CUDA and Piecewise CUDA Graphs Support (#23035)

2025-08-20 20:08:51 -07:00

pallas.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

rocm_aiter_fa.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

short_conv_attn.py

[Model] Add LFM2 architecture (#22845)

2025-08-21 09:35:07 +02:00

tree_attn.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

triton_attn.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

utils.py

[Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154)

2025-08-22 05:05:59 +00:00

xformers.py

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00