biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Doc] Add API reference for offline inference (#4710)

Browse Source
This commit is contained in:
Cyrus Leung
2024-05-14 08:47:42 +08:00
committed by GitHub
parent ac1fbf7fd2
commit 4bfa7e7f75
4 changed files with 17 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/offline_inference/llm.rst Normal file
View File

@@ -0,0 +1,6 @@
LLM Class
==========
.. autoclass:: vllm.LLM
:members:
:show-inheritance:

5
docs/source/offline_inference/sampling_params.rst Normal file
View File

@@ -0,0 +1,5 @@
Sampling Parameters
===================
.. autoclass:: vllm.SamplingParams
:members: