biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
11,076 Commits 2 Branches 140 Tags
b158df28139d134c2a43680104418eaa0d58e91c
Commit Graph

653 Commits

Author SHA1 Message Date
Woosuk Kwon
655a5e48df Introduce LLM class for offline inference (#115) 2023-05-21 17:04:18 -07:00
Woosuk Kwon
f746ced08d Implement stop strings and best_of (#114) 2023-05-21 11:18:00 -07:00
Woosuk Kwon
c3442c1f6f Refactor system architecture (#109) 2023-05-20 13:06:59 -07:00