[ROCm][CI] Prep Tests For Change To ROCM_ATTN As New Default Backend On ROCm (#36025)
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
This commit is contained in:
@@ -42,9 +42,7 @@ SAMPLE_PROMPT = BatchLogprobsComposition.SAMPLE_PROMPT
|
||||
# Force LLM instances into an identical, deterministic execution
|
||||
# mode so the test isolates spec-decode correctness only:
|
||||
ROCM_DETERMINISM_KWARGS: dict = (
|
||||
dict(
|
||||
max_num_seqs=1,
|
||||
)
|
||||
dict(max_num_seqs=1, attention_backend="TRITON_ATTN")
|
||||
if current_platform.is_rocm()
|
||||
else {}
|
||||
)
|
||||
|
||||
Reference in New Issue
Block a user