Chauncey f67ee8b859 [Perf] Optimize chat completion streaming performance (#33782) ...

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

2026-02-04 12:30:36 +00:00

..

anthropic

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

cli

[UX] Default api_server_count to dp_size if not specified (#32525)

2026-01-22 17:35:35 +00:00

mcp

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

openai

[Perf] Optimize chat completion streaming performance (#33782)

2026-02-04 12:30:36 +00:00

pooling

use ORJSONResponse when available to improve the efficiency of request process (#33548)

2026-02-04 10:04:11 +00:00

sagemaker

[Frontend] Cleanup api server (#33158)

2026-01-27 15:18:10 +00:00

serve

[Misc] support collect_env for endpoint /server_info (#33246)

2026-02-01 01:42:59 +08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

[Perf] Add skip_clone to SamplingParams for internal request handling (#31041)

2025-12-24 14:35:57 -08:00

chat_utils.py

[Bugfix] Do not add extra \n for image-only cases when constructing multimodal text prompts. (#33647)

2026-02-03 06:43:47 -08:00

constants.py

[responsesAPI][6] Fix multi turn MCP tokenization (#30230)

2025-12-10 10:13:13 +08:00

grpc_server.py

[Misc] Log vLLM logo when starting server (#32796)

2026-01-23 11:15:12 +08:00

launcher.py

[Realtime API] Adds minimal realtime API based on websockets (#33187)

2026-01-30 18:41:29 +08:00

llm.py

[Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060)

2026-02-04 01:48:40 +00:00

logger.py

[log] enable max_log_len trim only when needed (#31482)

2026-01-05 03:55:43 +00:00

ssl.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[Frontend] Use new Renderer for Completions and Tokenize API (#32863)

2026-01-31 04:51:15 -08:00