biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
947 Commits 2 Branches 140 Tags
e67c295b0c812a4969d5bbc70818f6d87c87f9e4
Commit Graph

2 Commits

Author SHA1 Message Date
Antoni Baum
bfdb1ba5c3 [Core] Improve detokenization performance for prefill (#3469) 
Co-authored-by: MeloYang <meloyang05@gmail.com>
 2024-03-22 13:44:12 -07:00
Antoni Baum
fb96c1e98c Asynchronous tokenization (#2879) 2024-03-15 23:37:01 +00:00