3 Commits

Author	SHA1	Message	Date
Cody Yu	bc8ad68455	[Misc][Refactor] Introduce ExecuteModelData (#4540)	2024-05-03 17:47:07 -07:00
SangBin Cho	3521ba4f25	[Core][Model runner refactoring 1/N] Refactor attn metadata term (#4518)	2024-05-03 10:20:12 -07:00
leiwen83	b38e42fbca	[Speculative decoding] Add ngram prompt lookup decoding (#4237) ... Co-authored-by: Lei Wen <wenlei03@qiyi.com>	2024-05-01 11:13:03 -07:00