[MODEL] FalconH1 (#18406)

Signed-off-by: dhia.rhaiem <dhia.rhaiem@tii.ae>
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: Ilyas Chahed <ilyas.chahed@tii.ae>
Co-authored-by: Jingwei Zuo <jingwei.zuo@tii.ae>
This commit is contained in:
Dhia Eddine Rhaiem
2025-05-21 15:59:06 +04:00
committed by GitHub
parent 61acfc45bc
commit eca18691d2
5 changed files with 798 additions and 59 deletions

View File

@@ -392,6 +392,11 @@ Specified using `--task generate`.
* `tiiuae/falcon-mamba-7b`, `tiiuae/falcon-mamba-7b-instruct`, etc.
* ✅︎
* ✅︎
- * `FalconH1ForCausalLM`
* Falcon-H1
* `tiiuae/Falcon-H1-34B-Base`, `tiiuae/Falcon-H1-34B-Instruct`, etc.
* ✅︎
* ✅︎
- * `GemmaForCausalLM`
* Gemma
* `google/gemma-2b`, `google/gemma-1.1-2b-it`, etc.