biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
a5bba7d234b4e0d82e6a64de82a8497760ed44cf
vllm/tests/spec_decode/utils.py
Sungjae Lee 0c63c34f72 [Bugfix][SpecDecode] kv corruption with bonus tokens in spec decode (#9730) 
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
2024-11-06 01:45:45 +00:00

7.5 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink