[Docker] Adding number of nvcc_threads during build as envar (#1893)

2023-12-07 16:00:32 -03:00
parent 42c02f5892
commit 24f60a54f4
3 changed files with 6 additions and 2 deletions
--- a/docs/source/serving/deploying_with_docker.rst
+++ b/docs/source/serving/deploying_with_docker.rst
@@ -29,7 +29,7 @@ You can build and run vLLM from source via the provided dockerfile. To build vLL

 .. code-block:: console

-    $ DOCKER_BUILDKIT=1 docker build . --target vllm-openai --tag vllm/vllm-openai --build-arg max_jobs=8
+    $ DOCKER_BUILDKIT=1 docker build . --target vllm-openai --tag vllm/vllm-openai # optionally specifies: --build-arg max_jobs=8 --build-arg nvcc_threads=2

 To run vLLM: