Files

biondizzle 10c71a446c Remove flash-attn GIT_TAG override to main — causes FLASHATTENTION_FP8_TWO_LEVEL_INTERVAL undefined error

v0.19.0 pins a compatible flash-attn commit (2921022). The sed that
forced GIT_TAG to main pulled in newer code that references
FLASHATTENTION_FP8_TWO_LEVEL_INTERVAL which isn't defined in v0.19.0's
build config. Use the pinned commit instead.

2026-04-28 03:07:14 +00:00

Dockerfile

Remove flash-attn GIT_TAG override to main — causes FLASHATTENTION_FP8_TWO_LEVEL_INTERVAL undefined error

2026-04-28 03:07:14 +00:00

README.md

Updated to v0.11.1rc3

2025-10-23 18:11:41 +00:00

super_v3_reasoning_parser.py

custom weights

2026-04-28 02:10:48 +00:00

vllm_shim_module.py

custom weights

2026-04-28 02:08:00 +00:00

README.md

VLLM images for GH200

Hosted here

 docker login
# Alternative
# docker buildx build --platform linux/arm64 --memory=600g -t rajesh550/gh200-vllm:0.9.0.1 .
 docker build --memory=450g --platform linux/arm64 -t rajesh550/gh200-vllm:0.11.1rc2 . 2>&1 | tee build.log 
 docker push rajesh550/gh200-vllm:0.11.1rc2