[CI][DeepSeek] Add nightly DeepSeek R1 lm_eval tests on H200 (#30356)

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
This commit is contained in:
Matthew Bonanni
2026-01-05 17:17:59 -05:00
committed by GitHub
parent 32f4e4db00
commit 276e03b92c
5 changed files with 33 additions and 1 deletions

View File

@@ -0,0 +1,11 @@
model_name: "deepseek-ai/DeepSeek-R1"
accuracy_threshold: 0.95
num_questions: 1319
num_fewshot: 5
startup_max_wait_seconds: 1200
server_args: >-
--enforce-eager
--max-model-len 4096
--tensor-parallel-size 8
--enable-expert-parallel
--speculative-config '{"method":"mtp","num_speculative_tokens":1}'