vllm docker 0.8.1 with lmcache

2025-04-01 20:44:21 +00:00
parent 9f2769285a
commit 57ceca8b4f
2 changed files with 141 additions and 0 deletions
--- a/vllm/README.md
+++ b/vllm/README.md
@@ -0,0 +1,9 @@
+# VLLM images for GH200
+
+Hosted [here](https://hub.docker.com/repository/docker/rajesh550/gh200-vllm)
+
+```bash
+docker login
+docker build --platform linux/arm64 -t rajesh550/gh200-vllm:0.8.1 .
+docker push rajesh550/gh200-vllm:0.8.1
+```