biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Doc] Move guide for multimodal model and other improvements (#6168)

Browse Source
This commit is contained in:
Cyrus Leung
2024-07-06 17:18:59 +08:00
committed by GitHub
parent 175c43eca4
commit 9389380015
8 changed files with 61 additions and 67 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/dev/input_processing/model_inputs_index.rst
View File

@@ -5,10 +5,10 @@ Input Processing
.. currentmodule:: vllm.inputs
vLLM provides a mechanism for defining input processors for each model so that the inputs are processed
in :class:`~vllm.LLMEngine` before they are passed to model executors.
Each model can override parts of vLLM's :ref:`input processing pipeline <input_processing_pipeline>` via
:data:`~vllm.inputs.INPUT_REGISTRY` and :data:`~vllm.multimodal.MULTIMODAL_REGISTRY`.
Currently, this mechanism is only utilized in :ref:`multi-modal models <multi_modality>` for preprocessing multi-modal input
Currently, this mechanism is only utilized in :ref:`multi-modal <multi_modality>` models for preprocessing multi-modal input
data in addition to input prompt, but it can be extended to text-only language models when needed.
Guides