[CI/Build] Support compilation with local cutlass path (#10423) (#10424)

This commit is contained in:
wchen61
2024-11-20 13:35:50 +08:00
committed by GitHub
parent 709c9f1f25
commit 7629a9c6e5
2 changed files with 27 additions and 2 deletions

View File

@@ -170,6 +170,18 @@ To build vLLM using an existing PyTorch installation:
$ pip install -e . --no-build-isolation
Use the local cutlass for compilation
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Currently, before starting the build process, vLLM fetches cutlass code from GitHub. However, there may be scenarios where you want to use a local version of cutlass instead.
To achieve this, you can set the environment variable VLLM_CUTLASS_SRC_DIR to point to your local cutlass directory.
.. code-block:: console
$ git clone https://github.com/vllm-project/vllm.git
$ cd vllm
$ VLLM_CUTLASS_SRC_DIR=/path/to/cutlass pip install -e .
Troubleshooting
~~~~~~~~~~~~~~~