biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Doc] Guide for Incremental Compilation Workflow (#19109)

Browse Source
This commit is contained in:
Michael Goin
2025-06-25 22:06:46 +09:00
committed by GitHub
parent c53fec1fcb
commit bf5181583f
4 changed files with 313 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
docs/getting_started/installation/gpu/cuda.inc.md
View File

@@ -151,6 +151,9 @@ pip install -e .
[sccache](https://github.com/mozilla/sccache) works similarly to `ccache`, but has the capability to utilize caching in remote storage environments.
The following environment variables can be set to configure the vLLM `sccache` remote: `SCCACHE_BUCKET=vllm-build-sccache SCCACHE_REGION=us-west-2 SCCACHE_S3_NO_CREDENTIALS=1`. We also recommend setting `SCCACHE_IDLE_TIMEOUT=0`.
!!! note "Faster Kernel Development"
For frequent C++/CUDA kernel changes, after the initial `pip install -e .` setup, consider using the [Incremental Compilation Workflow](../../contributing/incremental_build.md) for significantly faster rebuilds of only the modified kernel code.
##### Use an existing PyTorch installation
There are scenarios where the PyTorch dependency cannot be easily installed via pip, e.g.: