biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Docs] Add Modal to deployment frameworks (#11907)

Browse Source
This commit is contained in:
Charles Frye
2025-01-09 15:26:37 -08:00
committed by GitHub
parent 9a228348d2
commit 36f5303578
3 changed files with 9 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
docs/source/deployment/frameworks/modal.md Normal file
View File

@@ -0,0 +1,7 @@
(deployment-modal)=
# Modal
vLLM can be run on cloud GPUs with [Modal](https://modal.com), a serverless computing platform designed for fast auto-scaling.
For details on how to deploy vLLM on Modal, see [this tutorial in the Modal documentation](https://modal.com/docs/examples/vllm_inference).