youkaichao 20cfcdec99 [Core][Optimization] change python dict to pytorch tensor for blocks to swap (#4659)

2024-05-08 12:07:05 -07:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

paged_attn.py

[Core][Optimization] change python dict to pytorch tensor for blocks to swap (#4659)

2024-05-08 12:07:05 -07:00

prefix_prefill.py

[Bugfix][Kernel] allow non-power-of-2 for prefix prefill with alibi (#4573)

2024-05-08 09:19:58 -07:00

triton_flash_attention.py

[ROCm][Hardware][AMD] Enable group query attention for triton FA (#4406)

2024-04-26 23:37:40 -07:00