vllm/examples/online_serving at 998e2d91f84e2b30dc40c8543b879d4e412d6f14 - vllm

chart-helm

[Doc]: Make extraInit containers fully configurable in helm chart (#27497 )

2025-11-06 20:27:16 +00:00

dashboards

[Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661 )

2026-01-20 12:28:41 +00:00

disaggregated_encoder

[Doc] Update docs for MM model development with context usage (#32691 )

2026-01-20 10:37:35 -08:00

disaggregated_serving

[P/D] rework mooncake connector and introduce its bootstrap server (#31034 )

2026-02-03 08:08:25 -08:00

disaggregated_serving_p2p_nccl_xpyd

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336 )

2025-10-07 16:46:44 +08:00

elastic_ep

Remove all2all backend envvar (#30363 )

2025-12-18 19:46:28 +00:00

opentelemetry

[Docs] Fix syntax highlighting of shell commands (#19870 )

2025-06-23 17:59:09 +00:00

prometheus_grafana

[Doc]: fix typos in various files (#28945 )

2025-11-18 22:52:30 -08:00

structured_outputs

[Doc]: fixing typos in various files (#30540 )

2025-12-14 02:14:37 -08:00

api_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

disaggregated_prefill.sh

[BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628 )

2025-11-20 17:38:31 +00:00

gradio_openai_chatbot_webserver.py

[Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message history format (#29249 )

2025-11-24 00:47:54 +00:00

gradio_webserver.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

kv_events_subscriber.py

[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577 )

2025-12-30 00:17:16 +00:00

multi_instance_data_parallel.py

[Misc][DP] support customized aggregated logger for dp (#24354 )

2025-10-13 17:45:59 -07:00

multi-node-serving.sh

correct LWS deployment yaml (#23104 )

2025-09-02 12:04:59 +00:00

openai_chat_completion_client_for_multimodal.py

[Doc] Update usage of --limit-mm-per-prompt (#34148 )

2026-02-09 21:12:13 -08:00

openai_chat_completion_client_with_tools_required.py

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336 )

2025-10-07 16:46:44 +08:00

openai_chat_completion_client_with_tools_xlam_streaming.py

[Misc] Add SPDX-FileCopyrightText (#20428 )

2025-07-04 07:40:42 +00:00

openai_chat_completion_client_with_tools_xlam.py

[Misc] Add SPDX-FileCopyrightText (#20428 )

2025-07-04 07:40:42 +00:00

openai_chat_completion_client_with_tools.py

[Frontend] supports interleaved thinking (#28531 )

2025-11-13 16:14:13 +08:00

openai_chat_completion_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_chat_completion_tool_calls_with_reasoning.py

reasoning_content -> reasoning (#27752 )

2025-11-08 12:15:08 +00:00

openai_chat_completion_with_reasoning_streaming.py

reasoning_content -> reasoning (#27752 )

2025-11-08 12:15:08 +00:00

openai_chat_completion_with_reasoning.py

reasoning_content -> reasoning (#27752 )

2025-11-08 12:15:08 +00:00

openai_completion_client.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

openai_realtime_client.py

[Voxtral Realtime] Change name (#33716 )

2026-02-03 13:03:28 -08:00

openai_realtime_microphone_client.py

[Voxtral Realtime] Change name (#33716 )

2026-02-03 13:03:28 -08:00

openai_responses_client_with_mcp_tools.py

[Frontend] Add tool filtering support to ToolServer (#29224 )

2025-12-01 08:03:57 +00:00

openai_responses_client_with_tools.py

[responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798 )

2025-12-05 11:11:50 -05:00

openai_responses_client.py

[responsesAPI] parse reasoning item input (#28248 )

2025-11-22 15:42:11 +08:00

openai_transcription_client.py

[Audio] Improve Audio Inference Scripts (offline/online) (#29279 )

2025-12-31 23:34:18 +00:00

openai_translation_client.py

[Doc] Remove hardcoded Whisper in example openai translation client (#32027 )

2026-01-09 14:44:52 +00:00

prompt_embed_inference_with_openai_client.py

[Frontend] Use new Renderer for Completions and Tokenize API (#32863 )

2026-01-31 04:51:15 -08:00

ray_serve_deepseek.py

[V0 Deprecation] Remove VLLM_USE_V1 from docs and scripts (#26336 )

2025-10-07 16:46:44 +08:00

retrieval_augmented_generation_with_langchain.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

retrieval_augmented_generation_with_llamaindex.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00

rlhf_http.py

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943 )

2026-02-05 12:13:23 -05:00

run_cluster.sh

[FIX]Patch run-cluster.sh (fix for #28328 ) (#30002 )

2025-12-11 23:36:31 +00:00

sagemaker-entrypoint.sh

[Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502 )

2026-01-13 13:06:10 -08:00

streamlit_openai_chatbot_webserver.py

reasoning_content -> reasoning (#27752 )

2025-11-08 12:15:08 +00:00

token_generation_client.py

Explicitly set return_dict for apply_chat_template (#33372 )

2026-01-30 07:27:04 +00:00

utils.py

[Misc] Add SPDX-FileCopyrightText (#19100 )

2025-06-03 11:20:17 -07:00