Kathy Yu 2f385183f3 [Bugfix] Free cross attention block table for preempted-for-recompute sequence group. (#10013) ...

Signed-off-by: Kathy Yu <feiyangyu@google.com>

2025-01-02 10:28:09 -08:00

..

block

[Core] support LoRA and prompt adapter in content-based hashing for Block Manager v2 prefix caching (#8240)

2024-12-13 07:51:25 -08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

block_manager.py

[Core] support LoRA and prompt adapter in content-based hashing for Block Manager v2 prefix caching (#8240)

2024-12-13 07:51:25 -08:00

evictor.py

[Misc] Remove unused vllm/block.py (#11336)

2024-12-19 17:54:24 +00:00

interfaces.py

Prefix Cache Aware Scheduling [1/n] (#10128)

2024-11-22 21:15:55 -08:00

placeholder_block_space_manager.py

[Doc] Update docs to refer to pooling models (#11093)

2024-12-11 13:36:27 +00:00

scheduler.py

[Bugfix] Free cross attention block table for preempted-for-recompute sequence group. (#10013)

2025-01-02 10:28:09 -08:00