Yu-Zhou d0a7a2769d [Hardware][Gaudi][Feature] Support Contiguous Cache Fetch (#12139) ...

Signed-off-by: yuzhou <yuzhou@habana.ai>
Signed-off-by: zhouyu5 <yu.zhou@intel.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

2025-02-18 19:40:19 -08:00

..

mla

[Bugfix] Massage MLA's usage of flash attn for RoCM (#13310)

2025-02-14 21:33:25 -08:00

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

blocksparse_attn.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

flash_attn.py

[bugfix] fix early import of flash attention (#12959)

2025-02-09 00:06:56 +08:00

flashinfer.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

hpu_attn.py

[Hardware][Gaudi][Feature] Support Contiguous Cache Fetch (#12139)

2025-02-18 19:40:19 -08:00

ipex_attn.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

openvino.py

[Bugfix] Fix OpenVINO model runner (#12750)

2025-02-04 22:42:46 -08:00

pallas.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

placeholder_attn.py

[Model] IBM/NASA Prithvi Geospatial model (#12830)

2025-02-11 20:34:30 -08:00

rocm_flash_attn.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

torch_sdpa.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

triton_mla.py

[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)

2025-02-04 18:22:24 -08:00

utils.py

[bugfix] fix early import of flash attention (#12959)

2025-02-09 00:06:56 +08:00

xformers.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00