biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
2d1b9baa8f57fc59912c7bcd07fd630fb9d72c9d
vllm/vllm/entrypoints
History
Joe Runde 2d1b9baa8f
Some checks failed
Create Release / Create Release (push) Has been cancelled
Details
Create Release / Build Wheel (11.8, ubuntu-20.04, 3.10, 2.4.0) (push) Has been cancelled
Details
Create Release / Build Wheel (11.8, ubuntu-20.04, 3.11, 2.4.0) (push) Has been cancelled
Details
Create Release / Build Wheel (11.8, ubuntu-20.04, 3.12, 2.4.0) (push) Has been cancelled
Details
Create Release / Build Wheel (11.8, ubuntu-20.04, 3.9, 2.4.0) (push) Has been cancelled
Details
Create Release / Build Wheel (12.1, ubuntu-20.04, 3.10, 2.4.0) (push) Has been cancelled
Details
Create Release / Build Wheel (12.1, ubuntu-20.04, 3.11, 2.4.0) (push) Has been cancelled
Details
Create Release / Build Wheel (12.1, ubuntu-20.04, 3.12, 2.4.0) (push) Has been cancelled
Details
Create Release / Build Wheel (12.1, ubuntu-20.04, 3.9, 2.4.0) (push) Has been cancelled
Details
[Bugfix] Fix request cancellation without polling (#11190)
2024-12-17 12:26:32 -08:00
..
openai
[Bugfix] Fix request cancellation without polling (#11190)
2024-12-17 12:26:32 -08:00
__init__.py
Change the name to vLLM (#150)
2023-06-17 03:07:40 -07:00
api_server.py
[Bugfix] Fix request cancellation without polling (#11190)
2024-12-17 12:26:32 -08:00
chat_utils.py
[Frontend] Add OpenAI API support for input_audio (#11027)
2024-12-16 22:09:58 -08:00
launcher.py
[Core][Bugfix][Perf] Introduce MQLLMEngine to avoid asyncio OH (#8157)
2024-09-18 13:56:58 +00:00
llm.py
[Core] V1: Use multiprocessing by default (#11074)
2024-12-13 16:27:32 -08:00
logger.py
[Frontend] API support for beam search (#9087)
2024-10-05 23:39:03 -07:00
utils.py
[Bugfix] Fix request cancellation without polling (#11190)
2024-12-17 12:26:32 -08:00