vllm/vllm/model_executor/models at 4fd937502827a7e06c54ded1f9d9b70ff640e222 - vllm

__init__.py

[Model] Molmo vLLM Integration (#9016 )

2024-10-14 07:56:24 -07:00

arctic.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

baichuan.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

bart.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

bert.py

Support Roberta embedding models (#9387 )

2024-11-14 21:23:29 +00:00

blip2.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

blip.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346 )

2024-11-01 16:21:10 -07:00

bloom.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

chameleon.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

chatglm.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

clip.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346 )

2024-11-01 16:21:10 -07:00

commandr.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

dbrx.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

decilm.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

deepseek_v2.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

deepseek.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

eagle.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

exaone.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

falcon.py

Add default value to avoid Falcon crash (#5363 ) (#10347 )

2024-11-15 08:52:20 +00:00

florence2.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

fuyu.py

[Bugfix] Fix unable to load some models (#10312 )

2024-11-14 16:55:54 -08:00

gemma2.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

gemma.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

glm4_vision_encoder.py

[CI/Build] drop support for Python 3.8 EOL (#8464 )

2024-11-06 07:11:55 +00:00

gpt2.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

gpt_bigcode.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

gpt_j.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

gpt_neox.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

granite.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

granitemoe.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

h2ovl.py

[1/N] Initial prototype for multi-modal processor (#10044 )

2024-11-13 12:39:03 +00:00

idefics2_vision_model.py

[Model] Add Idefics3 support (#9767 )

2024-11-06 11:41:17 +00:00

idefics3.py

[Model] Add BNB quantization support for Idefics3 (#10310 )

2024-11-14 06:31:44 +00:00

interfaces_base.py

[5/N] pass the whole config to model (#9983 )

2024-11-09 14:17:28 +08:00

interfaces.py

[Model] Support Mamba (#6484 )

2024-10-11 15:40:06 +00:00

intern_vit.py

[VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217 )

2024-10-23 11:27:37 +00:00

internlm2_ve.py

[Bugfix] Fix unable to load some models (#10312 )

2024-11-14 16:55:54 -08:00

internlm2.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

internvl.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

jais.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

jamba.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

llama.py

[Perf] Reduce peak memory usage of llama (#10339 )

2024-11-15 00:38:20 +00:00

llava_next_video.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

llava_next.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

llava_onevision.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

llava.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

mamba_cache.py

[Kernel][Model] Improve continuous batching for Jamba and Mamba (#9189 )

2024-10-16 12:12:43 -04:00

mamba.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

medusa.py

[Misc] Medusa supports custom bias (#10361 )

2024-11-16 16:33:01 +00:00

minicpm3.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

minicpm.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

minicpmv.py

[Bugfix] Fix unable to load some models (#10312 )

2024-11-14 16:55:54 -08:00

mixtral_quant.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

mixtral.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

mllama.py

[Encoder Decoder] Update Mllama to run with both FlashAttention and XFormers (#9982 )

2024-11-12 10:53:57 -08:00

mlp_speculator.py

[Bugfix] Fix unable to load some models (#10312 )

2024-11-14 16:55:54 -08:00

module_mapping.py

[Model][LoRA]LoRA support added for MiniCPMV2.5 (#7199 )

2024-09-29 06:59:45 +00:00

molmo.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

mpt.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

nemotron.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

nvlm_d.py

[Bugfix] Fix _init_vision_model in NVLM_D model (#9611 )

2024-10-23 14:09:04 +00:00

olmo.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

olmoe.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

opt.py

[V1] Support VLMs with fine-grained scheduling (#9871 )

2024-11-13 04:53:13 +00:00

orion.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

paligemma.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

persimmon.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

phi3_small.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

phi3.py

[CI/Build] drop support for Python 3.8 EOL (#8464 )

2024-11-06 07:11:55 +00:00

phi3v.py

[1/N] Initial prototype for multi-modal processor (#10044 )

2024-11-13 12:39:03 +00:00

phi.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

phimoe.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

pixtral.py

[1/N] Initial prototype for multi-modal processor (#10044 )

2024-11-13 12:39:03 +00:00

qwen2_audio.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

qwen2_cls.py

[Model] Support Qwen2 embeddings and use tags to select model tests (#10184 )

2024-11-14 20:23:09 -08:00

qwen2_moe.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

qwen2_rm.py

[Model] Support Qwen2 embeddings and use tags to select model tests (#10184 )

2024-11-14 20:23:09 -08:00

qwen2_vl.py

[1/N] Initial prototype for multi-modal processor (#10044 )

2024-11-13 12:39:03 +00:00

qwen2.py

[Model] Support Qwen2 embeddings and use tags to select model tests (#10184 )

2024-11-14 20:23:09 -08:00

qwen.py

[1/N] Initial prototype for multi-modal processor (#10044 )

2024-11-13 12:39:03 +00:00

registry.py

[Model] Support Qwen2 embeddings and use tags to select model tests (#10184 )

2024-11-14 20:23:09 -08:00

roberta.py

Support Roberta embedding models (#9387 )

2024-11-14 21:23:29 +00:00

siglip.py

[Core][VLM] Add precise multi-modal placeholder tracking (#8346 )

2024-11-01 16:21:10 -07:00

solar.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

stablelm.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

starcoder2.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

ultravox.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00

utils.py

[misc] error early for old-style class (#10304 )

2024-11-13 18:55:39 -08:00

xverse.py

[6/N] pass whole config to inner model (#10205 )

2024-11-11 06:41:46 +00:00