biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Remove AsyncLLMEngine busy loop, shield background task (#1059)

Browse Source
This commit is contained in:
Antoni Baum
2023-09-17 00:29:08 -07:00
committed by GitHub
parent e3e79e9e8a
commit ff36139ffc
4 changed files with 154 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
requirements-dev.txt
View File

@@ -11,3 +11,4 @@ types-setuptools
# testing
pytest
pytest-forked
pytest-asyncio