biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Update PyTorch to 2.7.0 (#16859)

Browse Source
This commit is contained in:
Huy Do
2025-04-29 19:08:04 -07:00
committed by GitHub
parent 1c2bc7ead0
commit 2c4f59afc3
18 changed files with 102 additions and 77 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/getting_started/installation/gpu/cuda.inc.md
View File

@@ -1,6 +1,6 @@
# Installation
vLLM contains pre-compiled C++ and CUDA (12.1) binaries.
vLLM contains pre-compiled C++ and CUDA (12.6) binaries.
## Requirements
@@ -23,12 +23,12 @@ Therefore, it is recommended to install vLLM with a **fresh new** environment. I
You can install vLLM using either `pip` or `uv pip`:
```console
# Install vLLM with CUDA 12.4.
# Install vLLM with CUDA 12.6.
pip install vllm # If you are using pip.
uv pip install vllm # If you are using uv.
```
As of now, vLLM's binaries are compiled with CUDA 12.4 and public PyTorch release versions by default. We also provide vLLM binaries compiled with CUDA 12.1, 11.8, and public PyTorch release versions:
As of now, vLLM's binaries are compiled with CUDA 12.6 and public PyTorch release versions by default. We also provide vLLM binaries compiled with CUDA 12.8, 11.8, and public PyTorch release versions:
```console
# Install vLLM with CUDA 11.8.