biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Doc] Add documentation for offline API docs feature (#32134)

Browse Source 
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
This commit is contained in:
RickyChen / 陳昭儒
2026-01-12 18:33:48 +08:00
committed by GitHub
parent 05e8981234
commit a5f89ae296
1 changed files with 8 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/serving/openai_compatible_server.md
View File

@@ -173,6 +173,14 @@ with `--enable-request-id-headers`.
print(completion._request_id)
```
## Offline API Documentation
The FastAPI `/docs` endpoint requires an internet connection by default. To enable offline access in air-gapped environments, use the `--enable-offline-docs` flag:
```bash
vllm serve NousResearch/Meta-Llama-3-8B-Instruct --enable-offline-docs
```
## API Reference
### Completions API