biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Core] add support for reasoning parser plugins (#28075)

Browse Source 
Signed-off-by: walter beller-morales <walter.beller.morales@gmail.com>
This commit is contained in:
Walter Beller-Morales
2025-11-05 12:15:06 -05:00
committed by GitHub
parent c18f88c6ca
commit 752ddeacaa
6 changed files with 62 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
vllm/v1/structured_output/__init__.py
View File

@@ -64,6 +64,15 @@ class StructuredOutputManager:
self.tokenizer = init_tokenizer_from_configs(
model_config=self.vllm_config.model_config
)
reasoning_parser = (
self.vllm_config.structured_outputs_config.reasoning_parser
)
reasoning_parser_plugin = (
self.vllm_config.structured_outputs_config.reasoning_parser_plugin
)
if reasoning_parser_plugin and len(reasoning_parser_plugin) > 3:
ReasoningParserManager.import_reasoning_parser(reasoning_parser_plugin)
reasoning_parser = (
self.vllm_config.structured_outputs_config.reasoning_parser
)