biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Misc] Consolidate example usage of OpenAI client for multimodal models (#9412)

Browse Source 
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Roger Wang
2024-10-16 04:20:51 -07:00
committed by GitHub
parent cee711fdbb
commit 59230ef32b
4 changed files with 237 additions and 217 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/models/vlm.rst
View File

@@ -241,7 +241,7 @@ To consume the server, you can use the OpenAI client like in the example below:
print("Chat completion output:", chat_response.choices[0].message.content)
A full code example can be found in `examples/openai_vision_api_client.py <https://github.com/vllm-project/vllm/blob/main/examples/openai_vision_api_client.py>`_.
A full code example can be found in `examples/openai_api_client_for_multimodal.py <https://github.com/vllm-project/vllm/blob/main/examples/openai_api_client_for_multimodal.py>`_.
.. note::