[V1] VLM - Run the mm_mapper preprocessor in the frontend process (#10640)
Signed-off-by: Roger Wang <ywang@roblox.com> Co-authored-by: Michael Goin <michael@neuralmagic.com> Co-authored-by: Roger Wang <ywang@roblox.com>
This commit is contained in:
committed by
GitHub
parent
f6084f6324
commit
3bc94cab69
@@ -27,9 +27,8 @@ def make_request() -> EngineCoreRequest:
|
||||
request_id=uuid.uuid4(),
|
||||
prompt=PROMPT,
|
||||
prompt_token_ids=PROMPT_TOKENS,
|
||||
mm_data=None,
|
||||
mm_inputs=None,
|
||||
mm_placeholders=None,
|
||||
mm_processor_kwargs=None,
|
||||
sampling_params=SamplingParams(),
|
||||
eos_token_id=None,
|
||||
arrival_time=time.time(),
|
||||
|
||||
Reference in New Issue
Block a user