biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

adds jais 2 support (#30188)

Browse Source 
Signed-off-by: sarathc-cerebras <sarath.chandran@cerebras.net>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
(cherry picked from commit 28d15ab56b)
This commit is contained in:
sarathc-cerebras
2025-12-18 21:16:58 +05:30
committed by Kevin H. Luu
parent 30fe765e9f
commit ac43367ced
4 changed files with 534 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
tests/models/registry.py
View File

@@ -295,6 +295,9 @@ _TEXT_GENERATION_EXAMPLE_MODELS = {
"internlm/internlm3-8b-instruct", trust_remote_code=True
),
"JAISLMHeadModel": _HfExamplesInfo("inceptionai/jais-13b-chat"),
"Jais2ForCausalLM": _HfExamplesInfo(
"inceptionai/Jais-2-8B-Chat", min_transformers_version="4.58"
),
"JambaForCausalLM": _HfExamplesInfo(
"ai21labs/AI21-Jamba-1.5-Mini",
extras={