biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Doc] Improve installation signposting (#12575)

Browse Source 
- Make device tab names more explicit
- Add comprehensive list of devices to
https://docs.vllm.ai/en/latest/getting_started/installation/index.html
- Add `attention` blocks to the intro of all devices that don't have
pre-built wheels/images

---------

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
Harry Mellor
2025-01-31 23:38:35 +00:00
committed by GitHub
parent fc542144c4
commit 60808bd4c7
13 changed files with 111 additions and 59 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
docs/source/getting_started/installation/gpu/index.md
View File

@@ -5,7 +5,8 @@ vLLM is a Python library that supports the following GPU variants. Select your G
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:selected:
:sync: cuda
:::{include} cuda.inc.md
@@ -15,7 +16,7 @@ vLLM is a Python library that supports the following GPU variants. Select your G
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
:::{include} rocm.inc.md
@@ -25,7 +26,7 @@ vLLM is a Python library that supports the following GPU variants. Select your G
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
:::{include} xpu.inc.md
@@ -45,7 +46,7 @@ vLLM is a Python library that supports the following GPU variants. Select your G
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:sync: cuda
:::{include} cuda.inc.md
@@ -55,7 +56,7 @@ vLLM is a Python library that supports the following GPU variants. Select your G
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
:::{include} rocm.inc.md
@@ -65,7 +66,7 @@ vLLM is a Python library that supports the following GPU variants. Select your G
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
:::{include} xpu.inc.md
@@ -87,7 +88,7 @@ vLLM is a Python library that supports the following GPU variants. Select your G
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:sync: cuda
:::{include} cuda.inc.md
@@ -97,14 +98,14 @@ vLLM is a Python library that supports the following GPU variants. Select your G
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
There is no extra information on creating a new Python environment for this device.
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
There is no extra information on creating a new Python environment for this device.
@@ -118,7 +119,7 @@ There is no extra information on creating a new Python environment for this devi
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:sync: cuda
:::{include} cuda.inc.md
@@ -128,7 +129,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
:::{include} rocm.inc.md
@@ -138,7 +139,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
:::{include} xpu.inc.md
@@ -157,7 +158,7 @@ There is no extra information on creating a new Python environment for this devi
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:sync: cuda
:::{include} cuda.inc.md
@@ -167,7 +168,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
:::{include} rocm.inc.md
@@ -177,7 +178,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
:::{include} xpu.inc.md
@@ -196,7 +197,7 @@ There is no extra information on creating a new Python environment for this devi
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:sync: cuda
:::{include} cuda.inc.md
@@ -206,7 +207,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
:::{include} rocm.inc.md
@@ -216,7 +217,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
:::{include} xpu.inc.md
@@ -233,7 +234,7 @@ There is no extra information on creating a new Python environment for this devi
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:sync: cuda
:::{include} cuda.inc.md
@@ -243,7 +244,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
:::{include} rocm.inc.md
@@ -253,7 +254,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
:::{include} xpu.inc.md
@@ -270,7 +271,7 @@ There is no extra information on creating a new Python environment for this devi
:::::{tab-set}
:sync-group: device
::::{tab-item} CUDA
::::{tab-item} NVIDIA CUDA
:sync: cuda
:::{include} cuda.inc.md
@@ -279,7 +280,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} ROCm
::::{tab-item} AMD ROCm
:sync: rocm
:::{include} rocm.inc.md
@@ -288,7 +289,7 @@ There is no extra information on creating a new Python environment for this devi
::::
::::{tab-item} XPU
::::{tab-item} Intel XPU
:sync: xpu
:::{include} xpu.inc.md