biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Model] Pipeline parallel support for JAIS (#7603)

Browse Source
This commit is contained in:
Besher Alkurdi
2024-08-17 21:11:09 +03:00
committed by GitHub
parent d95cc0a55c
commit e73f76eec6
2 changed files with 51 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/config.py
View File

@@ -36,6 +36,7 @@ _PP_SUPPORTED_MODELS = [
"AquilaForCausalLM",
"DeepseekV2ForCausalLM",
"InternLMForCausalLM",
"JAISLMHeadModel",
"LlamaForCausalLM",
"LLaMAForCausalLM",
"MistralForCausalLM",