Signed-off-by: Tsai, Louie <louie.tsai@intel.com> Signed-off-by: Louie Tsai <louie.tsai@intel.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Benchmark Suites
vLLM provides comprehensive benchmarking tools for performance testing and evaluation:
- Benchmark CLI:
vllm benchCLI tools and specialized benchmark scripts for interactive performance testing. - Parameter Sweeps: Automate
vllm benchruns for multiple configurations, useful for optimization and tuning. - Performance Dashboard: Automated CI that publishes benchmarks on each commit.