biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

docs: Add documentation for s390x cpu implementation (#14198)

Browse Source 
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
Dilip Gowda Bhagavan
2025-03-11 22:32:17 +05:30
committed by GitHub
parent 4bf82d4b90
commit 07964e2f30
3 changed files with 97 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

34
docs/source/getting_started/installation/cpu.md
View File

@@ -36,6 +36,16 @@ vLLM is a Python library that supports the following CPU variants. Select your C
::::
::::{tab-item} IBM Z (S390X)
:sync: s390x
:::{include} cpu/s390x.inc.md
:start-after: "# Installation"
:end-before: "## Requirements"
:::
::::
:::::
## Requirements
@@ -75,6 +85,16 @@ vLLM is a Python library that supports the following CPU variants. Select your C
::::
::::{tab-item} IBM Z (S390X)
:sync: s390x
:::{include} cpu/s390x.inc.md
:start-after: "## Requirements"
:end-before: "## Set up using Python"
:::
::::
:::::
## Set up using Python
@@ -123,6 +143,16 @@ Currently, there are no pre-built CPU wheels.
::::
::::{tab-item} IBM Z (s390x)
:sync: s390x
:::{include} cpu/s390x.inc.md
:start-after: "### Build wheel from source"
:end-before: "## Set up using Docker"
:::
::::
:::::
## Set up using Docker
@@ -147,6 +177,10 @@ $ docker run -it \
For ARM or Apple silicon, use `Dockerfile.arm`
::::
::::{tip}
For IBM Z (s390x), use `Dockerfile.s390x` and in `docker run` use flag `--dtype float`
::::
## Supported features
vLLM CPU backend supports the following vLLM features: