From 762b424a528e025ef3d9b02828eb926c6dbddb2c Mon Sep 17 00:00:00 2001 From: Ce Gao Date: Sat, 29 Mar 2025 11:46:57 +0800 Subject: [PATCH] [Docs] Document v0 engine support in reasoning outputs (#15739) Signed-off-by: Ce Gao --- docs/source/features/reasoning_outputs.md | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) diff --git a/docs/source/features/reasoning_outputs.md b/docs/source/features/reasoning_outputs.md index 879b16d4f..3a0be69f8 100644 --- a/docs/source/features/reasoning_outputs.md +++ b/docs/source/features/reasoning_outputs.md @@ -136,7 +136,14 @@ Remember to check whether the `reasoning_content` exists in the response before ## Structured output -The reasoning content is also available in the structured output. The structured output engine like `xgrammar` will use the reasoning content to generate structured output. +The reasoning content is also available in the structured output. The structured output engine like `xgrammar` will use the reasoning content to generate structured output. It is only supported in v0 engine now. + +```bash +VLLM_USE_V1=0 vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B \ + --enable-reasoning --reasoning-parser deepseek_r1 +``` + +Please note that the `VLLM_USE_V1` environment variable must be set to `0` to use the v0 engine. ```python from openai import OpenAI