[Model] Add support for DBRX (#3660)

This commit is contained in:
Megha Agarwal
2024-03-27 13:01:46 -07:00
committed by GitHub
parent d18f4e73f3
commit e24336b5a7
9 changed files with 713 additions and 0 deletions

View File

@@ -27,6 +27,10 @@ Alongside each architecture, we include some popular models that use it.
- ChatGLM
- :code:`THUDM/chatglm2-6b`, :code:`THUDM/chatglm3-6b`, etc.
- ✅︎
* - :code:`DbrxForCausalLM`
- DBRX
- :code:`databricks/dbrx-base`, :code:`databricks/dbrx-instruct`, etc.
-
* - :code:`DeciLMForCausalLM`
- DeciLM
- :code:`Deci/DeciLM-7B`, :code:`Deci/DeciLM-7B-instruct`, etc.