biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Feature] specify model in config.yaml (#14855)

Browse Source 
Signed-off-by: weizeng <weizeng@roblox.com>
This commit is contained in:
Wei Zeng
2025-03-21 00:26:03 -07:00
committed by GitHub
parent da6ea29f7a
commit 0fa3970deb
7 changed files with 102 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
tests/config/test_config.yaml Normal file
View File

@@ -0,0 +1,5 @@
port: 12312
served_model_name: mymodel
tensor_parallel_size: 2
trust_remote_code: true
multi_step_stream_outputs: false