Files
grace-gpu-containers/vllm/README.md

15 lines
425 B
Markdown
Raw Normal View History

2025-04-01 20:44:21 +00:00
# VLLM images for GH200
Hosted [here](https://hub.docker.com/repository/docker/rajesh550/gh200-vllm)
```bash
docker login
2025-06-04 03:22:03 +00:00
docker buildx build --platform linux/arm64 --memory=600g -t rajesh550/gh200-vllm:0.9.0.1 .
2025-06-04 04:47:47 +00:00
2025-08-20 21:02:46 +00:00
# Alternative
sudo docker build --memory=300g --platform linux/arm64 -t rajesh550/gh200-vllm:0.10.1 .
2025-06-04 04:47:47 +00:00
docker build --memory=300g -t rajesh550/gh200-vllm:0.9.0.1 .
2025-06-04 03:22:03 +00:00
docker push rajesh550/gh200-vllm:0.9.0.1
2025-04-01 20:44:21 +00:00
```