Pavani Majety 622f8abff8 [Bugfix] bugfix and add model test for flashinfer fp8 kv cache. (#8013)

2024-08-30 22:18:50 -07:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

blocksparse_attn.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

flash_attn.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

flashinfer.py

[Bugfix] bugfix and add model test for flashinfer fp8 kv cache. (#8013)

2024-08-30 22:18:50 -07:00

ipex_attn.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

openvino.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

pallas.py

[TPU][Bugfix] Fix tpu type api (#8035)

2024-08-30 09:01:26 -07:00

rocm_flash_attn.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

torch_sdpa.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

utils.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

xformers.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00