tests/data/test_config.yaml

port: 12312
served_model_name: mymodel
tensor_parallel_size: 2
[Frontend]-config-cli-args (#7737) Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com> 2024-08-30 08:21:02 -07:00			`port: 12312`
[Bugfix] Fix order of arguments matters in config.yaml (#8960) 2024-10-05 10:35:11 -07:00			`served_model_name: mymodel`
[Frontend]-config-cli-args (#7737) Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com> 2024-08-30 08:21:02 -07:00			`tensor_parallel_size: 2`