3 Commits

Author	SHA1	Message	Date
youkaichao	469f85c782	[Core][Optimization] change copy-on-write from dict[int, list] to list (#4648)	2024-05-07 11:06:32 -07:00
Cade Daniel	93deb0b38f	[Speculative decoding 4/9] Lookahead scheduling for speculative decoding (#3250)	2024-04-01 22:55:24 +00:00
Cade Daniel	14ccd94c89	[Core][Bugfix]Refactor block manager for better testability (#3492)	2024-03-27 23:59:28 -07:00