Woosuk Kwon 0c6f5023c3 [V1] Scheduler Refactoring [1/N] - Add Scheduler Interface (#15250) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

2025-03-20 17:50:43 -07:00

..

test_kv_cache_utils.py

[V1][Metrics] Add GPU prefix cache hit rate % gauge (#12592)

2025-02-11 08:27:25 +00:00

test_prefix_caching.py

[V1] Prompt logprobs + APC compatibility; prompt logprobs reqs cannot fill APC (#13949)

2025-03-08 01:48:12 +00:00

test_scheduler.py

[V1] Scheduler Refactoring [1/N] - Add Scheduler Interface (#15250)

2025-03-20 17:50:43 -07:00