3 Commits

Author	SHA1	Message	Date
Woosuk Kwon	c9b38be8aa	[Spec Decode] Make propose_draft_token_ids non-blocking for lower TTFT (#23041) ... Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>	2025-08-18 17:20:38 -07:00
Or Ozeri	c280066f9d	[v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728) ... Signed-off-by: Or Ozeri <oro@il.ibm.com>	2025-08-15 16:52:52 -07:00
Woosuk Kwon	d4d309409f	Implement Async Scheduling (#19970) ... Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>	2025-07-14 23:01:46 -07:00