tests/config/test_config.yaml

port: 12312
served_model_name: mymodel
tensor_parallel_size: 2
trust_remote_code: true
multi_step_stream_outputs: false
[Frontend]-config-cli-args (#7737) Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com> 2024-08-30 08:21:02 -07:00			`port: 12312`
[Bugfix] Fix order of arguments matters in config.yaml (#8960) 2024-10-05 10:35:11 -07:00			`served_model_name: mymodel`
[Frontend]-config-cli-args (#7737) Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by: Kaunil Dhruv <kaunil_dhruv@intuit.com> 2024-08-30 08:21:02 -07:00			`tensor_parallel_size: 2`
[Bugfix] Fix load config when using bools (#9533) 2024-10-27 10:46:41 -07:00			`trust_remote_code: true`
			`multi_step_stream_outputs: false`