biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix] Fix order of arguments matters in config.yaml (#8960)

Browse Source
This commit is contained in:
Andy Dai
2024-10-05 10:35:11 -07:00
committed by GitHub
parent cfadb9c687
commit 5df1834895
4 changed files with 36 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/serving/openai_compatible_server.md
View File

@@ -140,7 +140,7 @@ $ vllm serve SOME_MODEL --config config.yaml
```
---
**NOTE**
In case an argument is supplied using command line and the config file, the value from the commandline will take precedence.
In case an argument is supplied simultaneously using command line and the config file, the value from the commandline will take precedence.
The order of priorities is `command line > config file values > defaults`.
---