biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Nit][Benchmark]Fix example in benchmark_serving_structured_output.py (#19311)

Browse Source 
Signed-off-by: Lifan Shen <lifans@meta.com>
This commit is contained in:
Lifans
2025-06-07 03:25:38 -07:00
committed by GitHub
parent d2f0e7e615
commit 4e4f63ad45
1 changed files with 0 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
benchmarks/benchmark_serving_structured_output.py
View File

@@ -12,7 +12,6 @@ On the client side, run:
--model <your_model> \ --model <your_model> \
--dataset json \ --dataset json \
--structured-output-ratio 1.0 \ --structured-output-ratio 1.0 \
--structured-output-backend auto \
--request-rate 10 \ --request-rate 10 \
--num-prompts 1000 --num-prompts 1000