Woosuk Kwon f8f9ff57ee [Bugfix][TPU] Fix megacore setting for v5e-litepod (#6397)

2024-07-12 15:59:47 -07:00

..

__init__.py

[Core] Refactor Attention Take 2 (#3462)

2024-03-25 04:39:33 +00:00

abstract.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

blocksparse_attn.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

flash_attn.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

flashinfer.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

ipex_attn.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

openvino.py

[Hardware][Intel] OpenVINO vLLM backend (#5379)

2024-06-28 13:50:16 +00:00

pallas.py

[Bugfix][TPU] Fix megacore setting for v5e-litepod (#6397)

2024-07-12 15:59:47 -07:00

rocm_flash_attn.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

torch_sdpa.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

utils.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

xformers.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00