biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Feature] specify model in config.yaml (#15798)

Browse Source 
Signed-off-by: weizeng <weizeng@roblox.com>
This commit is contained in:
Wei Zeng
2025-04-01 01:20:06 -07:00
committed by GitHub
parent 8af5a5c4e5
commit 30d6a015e0
7 changed files with 109 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
tests/config/test_config_with_model.yaml Normal file
View File

@@ -0,0 +1,7 @@
# Same as test_config.yaml but with model specified
model: config-model
port: 12312
served_model_name: mymodel
tensor_parallel_size: 2
trust_remote_code: true
multi_step_stream_outputs: false