[Model] Add support for GraniteMoeShared models (#13313)

Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
2025-03-03 17:04:52 -07:00
parent 79e4937c65
commit c060b71408
4 changed files with 351 additions and 0 deletions
--- a/docs/source/models/supported_models.md
+++ b/docs/source/models/supported_models.md
@@ -298,6 +298,11 @@ See [this page](#generative-models) for more information on how to use generativ
  * `ibm-granite/granite-3.0-1b-a400m-base`, `ibm-granite/granite-3.0-3b-a800m-instruct`, `ibm/PowerMoE-3b`, etc.
  * ✅︎
  * ✅︎
+- * `GraniteMoeSharedForCausalLM`
+  * Granite MoE Shared
+  * `ibm-research/moe-7b-1b-active-shared-experts` (test model)
+  * ✅︎
+  * ✅︎
 - * `GritLM`
  * GritLM
  * `parasail-ai/GritLM-7B-vllm`.