biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
bc0644574ca12d754a031596bdcfe8e1f0e6ab39
vllm/tests/async_engine/api_server_async_engine.py
Antoni Baum 080438477f Start background task in AsyncLLMEngine.generate (#988) 
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
2023-09-08 00:03:39 -07:00

1.5 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink