[Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944)

Signed-off-by: FurtherAI <austin.veselka@lighton.ai> Co-authored-by: FurtherAI <austin.veselka@lighton.ai>
2024-11-13 02:28:13 -06:00
parent 3945c82346
commit 1b886aa104
8 changed files with 363 additions and 18 deletions
--- a/docs/source/models/supported_models.rst
+++ b/docs/source/models/supported_models.rst
@@ -584,6 +584,12 @@ Multimodal Embedding
    - :code:`TIGER-Lab/VLM2Vec-Full`
    - 🚧
    - ✅︎
+  * - :code:`Qwen2VLForConditionalGeneration`
+    - Qwen2-VL-based
+    - T + I
+    - :code:`MrLight/dse-qwen2-2b-mrl-v1`
+    - 
+    - ✅︎

 .. important::
  Some model architectures support both generation and embedding tasks.