biondizzle/grace-gpu-containers
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Rajesh Shashi Kumar
2025-09-24 01:43:49 -05:00
committed by GitHub
parent 201bbf5379
commit 31f4489d1f
1 changed files with 12 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
README.md
View File

@@ -1 +1,12 @@
# containers
# Building containers for GH200
Currently, prebuilt wheels for `vLLM` and `LMcache` are not available for `aarch64`. This can make setup tedious when working on modern `aarch64` platforms such as NVIDIA GH200.
This repository provides a Dockerfile to build a container with vLLM and all its dependencies pre-installed to try out various things such as KV offloading.
If you prefer not to build the image yourself, you can pull the ready-to-use image directly from Docker Hub:
`docker pull rajesh550/gh200-vllm:0.10.2`
👉 [Docker Hub](https://hub.docker.com/repository/docker/rajesh550/gh200-vllm/general)