Cade Daniel c32ab8be1a [Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding (#6964)

2024-07-31 00:53:21 +00:00

..

descriptions.md

[CI] the readability of benchmarking and prepare for dashboard (#5571)

2024-06-17 11:41:08 -07:00

latency-tests.json

[CI] the readability of benchmarking and prepare for dashboard (#5571)

2024-06-17 11:41:08 -07:00

nightly-tests.json

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

serving-tests.json

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding (#6964)

2024-07-31 00:53:21 +00:00

throughput-tests.json

[CI] the readability of benchmarking and prepare for dashboard (#5571)

2024-06-17 11:41:08 -07:00