Files
grace-gpu-containers/vllm
biondizzle ceab7ada22 Update flashinfer to v0.6.6 to match vLLM 0.18.x requirements
vLLM 0.18.x depends on flashinfer-python==0.6.6, was building 0.4.1
2026-04-03 07:13:16 +00:00
..
2025-10-23 18:11:41 +00:00

VLLM images for GH200

Hosted here

 docker login
# Alternative
# docker buildx build --platform linux/arm64 --memory=600g -t rajesh550/gh200-vllm:0.9.0.1 .
 docker build --memory=450g --platform linux/arm64 -t rajesh550/gh200-vllm:0.11.1rc2 . 2>&1 | tee build.log 
 docker push rajesh550/gh200-vllm:0.11.1rc2