biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Doc] Add API reference for offline inference (#4710)

Browse Source
This commit is contained in:
Cyrus Leung
2024-05-14 08:47:42 +08:00
committed by GitHub
parent ac1fbf7fd2
commit 4bfa7e7f75
4 changed files with 17 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/source/index.rst
View File

@@ -67,6 +67,13 @@ Documentation
getting_started/quickstart
getting_started/examples/examples_index
.. toctree::
:maxdepth: 1
:caption: Offline Inference
offline_inference/llm
offline_inference/sampling_params
.. toctree::
:maxdepth: 1
:caption: Serving
@@ -101,7 +108,6 @@ Documentation
:maxdepth: 2
:caption: Developer Documentation
dev/sampling_params
dev/engine/engine_index
dev/kernel/paged_attention
dev/dockerfile/dockerfile