[Doc] Reorganize user guide (#18661)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
7
docs/usage/README.md
Normal file
7
docs/usage/README.md
Normal file
@@ -0,0 +1,7 @@
|
||||
# Using vLLM
|
||||
|
||||
vLLM supports the following usage patterns:
|
||||
|
||||
- [Inference and Serving](../serving/offline_inference.md): Run a single instance of a model.
|
||||
- [Deployment](../deployment/docker.md): Scale up model instances for production.
|
||||
- [Training](../training/rlhf.md): Train or fine-tune a model.
|
||||
Reference in New Issue
Block a user