biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
32e7db25365415841ebc7c4215851743fbb1bad1
vllm/benchmarks/benchmark_serving.py
Cody Yu 77d9e514a2 [MISC] Replace input token throughput with total token throughput (#8164) 
Co-authored-by: Michael Goin <michael@neuralmagic.com>
2024-09-04 20:23:22 +00:00

29 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink