biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[cherry-pick][Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591)#37605

Browse Source 
Signed-off-by: khluu <khluu000@gmail.com>
This commit is contained in:
khluu
2026-03-19 15:06:38 -07:00
parent 89138b21cc
commit bcf2be9612
5 changed files with 42 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
tests/evals/gsm8k/configs/Qwen3.5-35B-A3B-DEP2.yaml Normal file
View File

@@ -0,0 +1,8 @@
model_name: "Qwen/Qwen3.5-35B-A3B"
accuracy_threshold: 0.86
num_questions: 1319
num_fewshot: 5
server_args: >-
--max-model-len 4096
--data-parallel-size 2
--enable-expert-parallel

9
tests/evals/gsm8k/configs/Qwen3.5-35B-A3B-FP8-DEP2.yaml Normal file
View File

@@ -0,0 +1,9 @@
model_name: "Qwen/Qwen3.5-35B-A3B-FP8"
accuracy_threshold: 0.86
num_questions: 1319
num_fewshot: 5
server_args: >-
--max-model-len 4096
--data-parallel-size 2
--enable-expert-parallel
--kv-cache-dtype fp8

2
tests/evals/gsm8k/configs/models-qwen35-blackwell.txt Normal file
View File

@@ -0,0 +1,2 @@
Qwen3.5-35B-A3B-DEP2.yaml
Qwen3.5-35B-A3B-FP8-DEP2.yaml