biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Frontend]-config-cli-args (#7737)

Browse Source 
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com>
This commit is contained in:
Kaunil Dhruv
2024-08-30 08:21:02 -07:00
committed by GitHub
parent 98cef6a227
commit 058344f89a
7 changed files with 185 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tests/data/test_config.yaml Normal file
View File

@@ -0,0 +1,2 @@
port: 12312
tensor_parallel_size: 2