vllm/docs/configuration

Configuration Options

This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority:

• Request parameters and input arguments
• Engine arguments
• Environment variables