[MODEL] Adding Support for Qwen3.5 Models (#34110)
Signed-off-by: JJJYmmm <1650675829@qq.com> Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: wulipc <wulipc@users.noreply.github.com> Co-authored-by: ywang96 <ywang96@users.noreply.github.com> Co-authored-by: Isotr0py <Isotr0py@users.noreply.github.com> Co-authored-by: Isotr0py <2037008807@qq.com> Co-authored-by: Roger Wang <hey@rogerw.io>
This commit is contained in:
@@ -1218,8 +1218,8 @@ class ModelConfig:
|
||||
if attn_type_list:
|
||||
return sum(t == 1 for t in attn_type_list[start:end])
|
||||
|
||||
# Hybrid model Qwen3Next
|
||||
layer_types_value = getattr(self.hf_config, "layer_types", None)
|
||||
# Hybrid model Qwen3Next Qwen3.5 Series
|
||||
layer_types_value = getattr(self.hf_text_config, "layer_types", None)
|
||||
if layer_types_value is not None:
|
||||
if block_type == "attention":
|
||||
return sum(
|
||||
|
||||
Reference in New Issue
Block a user