[Model] Add PaliGemma (#5189)

Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
2024-07-06 18:25:50 -07:00
parent 9389380015
commit 6206dcb29e
6 changed files with 557 additions and 2 deletions
--- a/docs/source/models/supported_models.rst
+++ b/docs/source/models/supported_models.rst
@@ -186,6 +186,10 @@ Vision Language Models
    - LLaVA-NeXT
    - :code:`llava-hf/llava-v1.6-mistral-7b-hf`, :code:`llava-hf/llava-v1.6-vicuna-7b-hf`, etc.
    -
+  * - :code:`PaliGemmaForConditionalGeneration`
+    - PaliGemma
+    - :code:`google/paligemma-3b-pt-224`, :code:`google/paligemma-3b-mix-224`, etc.
+    - 
  * - :code:`Phi3VForCausalLM`
    - Phi-3-Vision
    - :code:`microsoft/Phi-3-vision-128k-instruct`, etc.