Varun Sundar Rabindranath c2ec430ab5 [Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) ...

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

2024-09-27 13:32:07 -07:00

..

backends

[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378)

2024-09-27 13:32:07 -07:00

ops

[CI/Build] Avoid CUDA initialization (#8534)

2024-09-18 10:38:11 +00:00

__init__.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

layer.py

[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)

2024-08-06 16:51:47 -04:00

selector.py

[Kernel] Build flash-attn from source (#8245)

2024-09-20 23:27:10 -07:00