Add CMM_BUILD_DATE cache-bust arg to Dockerfile

Docker was reusing cached layers for sitecustomize.py and
vllm_managed_mem.py COPY steps, causing stale files in the image.
CMM_BUILD_DATE arg invalidates the cache for all CMM file copies.
This commit is contained in:
2026-04-11 23:19:48 +00:00
parent bcc872c2c3
commit be4198e754

View File

@@ -257,14 +257,15 @@ RUN pip uninstall -y pynvml && pip install nvidia-ml-py
# - cudaMemPrefetchAsync(GPU): actively migrates pages to GPU immediately,
# so model weight writes go to HBM/EGM, not system RAM
#
# vllm_managed_mem.py is the launcher that swaps the allocator before any
# CUDA operations and patches vLLM's memory validation to understand the
# larger managed memory space.
# vllm_managed_mem.py is the launcher that patches vLLM's memory validation
# to understand the larger managed memory space. No global allocator swap.
#
# sitecustomize.py is auto-loaded by Python in ALL subprocesses (including
# vLLM's EngineCore). It applies the allocator swap and torch.cuda patches
# before any CUDA operations in spawned processes.
# vLLM's EngineCore). It sets VLLM_KV_CACHE_USE_MANAGED_MEMORY=1 and patches
# MemorySnapshot/request_memory — does NOT swap the global allocator.
# ==============================================================================
ARG CMM_BUILD_DATE=default
RUN echo "CMM build: ${CMM_BUILD_DATE}" > /dev/null
COPY managed_alloc.cu /tmp/managed_alloc.cu
RUN nvcc -shared -o /usr/local/lib/libmanaged_alloc.so \
/tmp/managed_alloc.cu -Xcompiler -fPIC && rm /tmp/managed_alloc.cu