biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
24750f4cadd15a2b3a52f982e39eb9803749efbc
vllm/tests/spec_decode/test_ngram_worker.py
leiwen83 b38e42fbca [Speculative decoding] Add ngram prompt lookup decoding (#4237) 
Co-authored-by: Lei Wen <wenlei03@qiyi.com>
2024-05-01 11:13:03 -07:00

6.4 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink