Woosuk Kwon 3a0fba5cf4 [V1][Spec Decode] Handle draft tokens beyond max_model_len (#16087) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2025-04-21 12:38:50 -07:00

..

test_kv_cache_utils.py

[V1][Spec Decode] KV cache slots for eagle heads (#16370)

2025-04-12 19:42:51 -07:00

test_prefix_caching.py

[V1][Misc] stop update prefix cache stats when logs_stats is disabled (#16460)

2025-04-19 02:25:19 -07:00

test_scheduler_e2e.py

[V1] Support long_prefill_token_threshold in v1 scheduler (#15419)

2025-03-25 14:22:26 -07:00

test_scheduler.py

[V1][Spec Decode] Handle draft tokens beyond max_model_len (#16087)

2025-04-21 12:38:50 -07:00

test_specialized_manager.py

[V1] Implement sliding window attention in kv_cache_manager (#14097)

2025-04-01 00:33:17 -07:00