Add vllm bench [latency, throughput] CLI commands (#16508)

Browse Source

Signed-off-by: mgoin <mgoin64@gmail.com>

...

This commit is contained in:

Michael Goin

2025-04-15 00:10:35 -06:00

committed by GitHub

parent bc5dd4f669

commit b4fe16c75b

11 changed files with 1771 additions and 2 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

0

tests/benchmarks/__init__.py Normal file