Patrick von Platen 10152d2194 [Realtime API] Adds minimal realtime API based on websockets (#33187) ...

Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-01-30 18:41:29 +08:00

..

offline_inference

[model] Add support for openPangu7B-VL (#32449)

2026-01-30 15:54:27 +08:00

online_serving

[Realtime API] Adds minimal realtime API based on websockets (#33187)

2026-01-30 18:41:29 +08:00

others

Add flake8-implicit-str-concat rules to Ruff (#33191)

2026-01-28 04:56:10 +00:00

pooling

[Bugfix] Fix Qwen3-VL-Reranker load. (#33298)

2026-01-29 08:42:53 +00:00

template_alpaca.jinja

…

template_baichuan.jinja

…

template_chatglm2.jinja

…

template_chatglm.jinja

…

template_chatml.jinja

…

template_dse_qwen2_vl.jinja

…

template_falcon_180b.jinja

…

template_falcon.jinja

…

template_inkbot.jinja

…

template_teleflm.jinja

…

template_vlm2vec_phi3v.jinja

[Doc] Improve MM Pooling model documentation (#25966)

2025-09-30 18:58:29 +00:00

template_vlm2vec_qwen2vl.jinja

[Doc] Improve MM Pooling model documentation (#25966)

2025-09-30 18:58:29 +00:00

tool_chat_template_deepseekr1.jinja

Fix DeepSeek-R1-0528 chat template (#20717)

2025-07-10 17:47:36 +00:00

tool_chat_template_deepseekv3.jinja

[Feature] Support DeepSeekV3 Function Call (#17784)

2025-05-12 00:45:21 -07:00

tool_chat_template_deepseekv31.jinja

Support DeepSeek-V3.1 tool call (#23454)

2025-08-23 05:50:16 +00:00

tool_chat_template_functiongemma.jinja

[Frontend] add FunctionGemma tool parser support (#31218)

2025-12-25 15:29:25 +08:00

tool_chat_template_gemma3_pythonic.jinja

…

tool_chat_template_glm4.jinja

Fix GLM-4.6v flash tool calling in transformers 5.x (#31622)

2026-01-05 11:32:43 -08:00

tool_chat_template_granite_20b_fc.jinja

[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339)

2024-10-29 15:07:37 -07:00

tool_chat_template_granite.jinja

Change granite chat template to keep json list formatting for tool calls (#10452)

2024-11-19 18:16:54 -07:00

tool_chat_template_hermes.jinja

…

tool_chat_template_hunyuan_a13b.jinja

…

tool_chat_template_internlm2_tool.jinja

…

tool_chat_template_llama3.1_json.jinja

[Bugfix][Frontend] Update Llama Chat Templates to also support Non-Tool use (#10164)

2024-11-23 10:17:38 +08:00

tool_chat_template_llama3.2_json.jinja

[Misc] Update llama 3.2 template to support system prompt with images (#10901)

2024-12-05 05:54:06 +00:00

tool_chat_template_llama3.2_pythonic.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00

tool_chat_template_llama4_json.jinja

…

tool_chat_template_llama4_pythonic.jinja

[Frontend][Bug Fix] Update llama4 pythonic jinja template and llama4_pythonic parser (#17917)

2025-05-22 16:44:08 -07:00

tool_chat_template_minimax_m1.jinja

[Feature] Support MiniMax-M1 function calls features (#20297)

2025-07-03 06:48:27 +00:00

tool_chat_template_mistral3.jinja

…

tool_chat_template_mistral_parallel.jinja

[Bugfix] example template should not add parallel_tool_prompt if tools is none (#9007)

2024-10-03 03:04:17 +00:00

tool_chat_template_mistral.jinja

[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649)

2024-09-04 13:18:13 -07:00

tool_chat_template_phi4_mini.jinja

[Doc]: fixing typos to improve docs (#24480)

2025-09-08 23:06:04 -07:00

tool_chat_template_qwen3coder.jinja

…

tool_chat_template_toolace.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00

tool_chat_template_xlam_llama.jinja

…

tool_chat_template_xlam_qwen.jinja

…