3 Commits

Author	SHA1	Message	Date
Travis Johnson	cc0eaf12b1	[Bugfix] spec decode handle None entries in topk args in create_sequence_group_output (#7232) ... Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>	2024-08-22 09:33:48 -04:00
sroy745	14f91fe67c	[Spec Decode] Disable Log Prob serialization to CPU for spec decoding for both draft and target models. (#6485)	2024-07-20 23:58:58 -07:00
Cade Daniel	ab50275111	[Speculative decoding] Support target-model logprobs (#4378)	2024-05-03 15:52:01 -07:00