Chen Zhang e585b583a9 [Bugfix] Support testing prefill throughput with benchmark_serving.py --hf-output-len 1 (#8891)

2024-09-28 18:51:22 +00:00

34 KiB

Raw Blame History

View Raw