biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[ Bugfix ] Fix Prometheus Metrics With zeromq Frontend (#7279)

Browse Source 
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
This commit is contained in:
Robert Shaw
2024-08-18 16:19:48 -04:00
committed by GitHub
parent ab7165f2c7
commit e3b318216d
7 changed files with 366 additions and 116 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
tests/entrypoints/openai/test_basic.py
View File

@@ -50,12 +50,3 @@ async def test_check_health(client: openai.AsyncOpenAI):
response = requests.get(base_url + "/health")
assert response.status_code == HTTPStatus.OK
@pytest.mark.asyncio
async def test_log_metrics(client: openai.AsyncOpenAI):
base_url = str(client.base_url)[:-3].strip("/")
response = requests.get(base_url + "/metrics")
assert response.status_code == HTTPStatus.OK