biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011)

Browse Source
This commit is contained in:
Jiaxiang
2024-01-12 11:26:49 +08:00
committed by GitHub
parent 50376faa7b
commit 6549aef245
9 changed files with 242 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
docs/source/dev/engine/async_llm_engine.rst Normal file
View File

@@ -0,0 +1,7 @@
AsyncLLMEngine
=================================
.. autoclass:: vllm.engine.async_llm_engine.AsyncLLMEngine
:members: generate, abort
:show-inheritance: