[Model] Add Phi-2 LoRA support (#4886)

2024-05-21 13:24:17 +08:00
parent d130b573a0
commit f12c3b5b3d
4 changed files with 99 additions and 6 deletions
--- a/docs/source/models/supported_models.rst
+++ b/docs/source/models/supported_models.rst
@@ -118,7 +118,7 @@ Alongside each architecture, we include some popular models that use it.
  * - :code:`PhiForCausalLM`
    - Phi
    - :code:`microsoft/phi-1_5`, :code:`microsoft/phi-2`, etc.
-    -
+    - ✅︎
  * - :code:`Phi3ForCausalLM`
    - Phi-3
    - :code:`microsoft/Phi-3-mini-4k-instruct`, :code:`microsoft/Phi-3-mini-128k-instruct`, etc.