biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Support OpenAI API server in benchmark_serving.py (#2172)

Browse Source
This commit is contained in:
Harry Mellor
2024-01-19 04:34:08 +00:00
committed by GitHub
parent dd7e8f5f64
commit 2709c0009a
2 changed files with 51 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
.gitignore vendored
View File

@@ -181,3 +181,6 @@ _build/
# hip files generated by PyTorch
*.hip
*_hip*
# Benchmark dataset
*.json