Misha Efimov ba464e6ae2 Add ORCA endpoint load metrics support (#24905) ...

Signed-off-by: Misha Efimov <mef@google.com>

2025-11-03 08:21:31 +00:00

..

anthropic

Adds anthropic /v1/messages endpoint to openai api_server (#27882)

2025-11-01 12:45:42 -07:00

cli

[Frontend] Add vllm bench sweep to CLI (#27639)

2025-10-29 05:59:48 -07:00

openai

Add ORCA endpoint load metrics support (#24905)

2025-11-03 08:21:31 +00:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00

chat_utils.py

fix: allow HuggingFace standard chat template params via **kwargs (#27622)

2025-10-28 21:12:34 +08:00

constants.py

Limit HTTP header count and size (#23267)

2025-08-20 17:57:37 +00:00

context.py

[Frontend] [gpt-oss] Tool json call parsing error retry (#27675)

2025-10-29 09:42:44 +00:00

harmony_utils.py

[Frontend] [gpt-oss] Mcp type bug (#27689)

2025-10-29 10:01:32 +00:00

launcher.py

[Chore] Separate out vllm.utils.network_utils (#27164)

2025-10-19 03:06:32 -07:00

llm.py

Fix(llm): Abort orphaned requests when llm.chat() batch fails Fixes #26081 (#27420)

2025-11-02 16:24:01 +00:00

logger.py

[Misc] Separate prompt logging to debug (#26713)

2025-10-13 09:04:18 -07:00

renderer.py

[Frontend] Require flag for loading text and image embeds (#27204)

2025-10-22 15:52:02 +00:00

score_utils.py

[Model] Add num_cached_tokens for PoolingRequestOutput (#27378)

2025-10-23 14:03:42 +08:00

ssl.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

tool_server.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

tool.py

[CI][gpt-oss] Enable python tool tests in CI (#24315)

2025-10-06 04:20:06 +00:00

utils.py

[Chore]:Extract math and argparse utilities to separate modules (#27188)

2025-10-26 04:03:32 -07:00