[Misc][Model][Refactor] Pass the prefix into Linear layers (#31669)

Signed-off-by: Wang Kunpeng <1289706727@qq.com>
This commit is contained in:
Wang Kunpeng
2026-01-06 04:03:18 +08:00
committed by GitHub
parent 02dbb933cb
commit 5708297e4e
17 changed files with 181 additions and 40 deletions

View File

@@ -78,6 +78,7 @@ class JambaMoE(nn.Module):
bias=False,
quant_config=None,
params_dtype=params_dtype,
prefix=f"{prefix}.router",
)
self.experts = FusedMoE(