2 Commits

Author	SHA1	Message	Date
sroy745	14f91fe67c	[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. (#6485)	2024-07-20 23:58:58 -07:00
Cade Daniel	ab50275111	[Speculative decoding] Support target-model logprobs (#4378)	2024-05-03 15:52:01 -07:00