biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[CI] the readability of benchmarking and prepare for dashboard (#5571)

Browse Source 
[CI] Improve the readability of performance benchmarking results and prepare for upcoming performance dashboard (#5571)
This commit is contained in:
Kuntai Du
2024-06-17 11:41:08 -07:00
committed by GitHub
parent ab66536dbf
commit 9e4e6fe207
8 changed files with 213 additions and 111 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
.buildkite/nightly-benchmarks/run-benchmarks-suite.sh
View File

@@ -343,9 +343,9 @@ main() {
QUICK_BENCHMARK_ROOT=../.buildkite/nightly-benchmarks/
# benchmarking
run_serving_tests $QUICK_BENCHMARK_ROOT/serving-tests.json
run_latency_tests $QUICK_BENCHMARK_ROOT/latency-tests.json
run_throughput_tests $QUICK_BENCHMARK_ROOT/throughput-tests.json
run_serving_tests $QUICK_BENCHMARK_ROOT/tests/serving-tests.json
run_latency_tests $QUICK_BENCHMARK_ROOT/tests/latency-tests.json
run_throughput_tests $QUICK_BENCHMARK_ROOT/tests/throughput-tests.json
# postprocess benchmarking results