20 lines
793 B
Markdown
20 lines
793 B
Markdown
# Installation
|
|
|
|
vLLM supports the following hardware platforms:
|
|
|
|
- [GPU](gpu.md)
|
|
- [NVIDIA CUDA](gpu.md#nvidia-cuda)
|
|
- [AMD ROCm](gpu.md#amd-rocm)
|
|
- [Intel XPU](gpu.md#intel-xpu)
|
|
- [CPU](cpu.md)
|
|
- [Intel/AMD x86](cpu.md#intelamd-x86)
|
|
- [ARM AArch64](cpu.md#arm-aarch64)
|
|
- [Apple silicon](cpu.md#apple-silicon)
|
|
- [IBM Z (S390X)](cpu.md#ibm-z-s390x)
|
|
|
|
## Hardware Plugins
|
|
|
|
vLLM supports third-party hardware plugins that live **outside** the main `vllm` repository. These follow the [Hardware-Pluggable RFC](../../design/plugin_system.md).
|
|
|
|
A list of all supported hardware can be found on the [vllm.ai website](https://vllm.ai/#hardware). If you want to add new hardware, please contact us on [Slack](https://slack.vllm.ai/) or [Email](mailto:collaboration@vllm.ai).
|