[EPLB][ROCm]: support EPBL for ROCm backend (#27731)

Signed-off-by: Perry Zhang <perzhang@amd.com>
Co-authored-by: Perry Zhang <perzhang@amd.com>
This commit is contained in:
PerryZhang01
2025-11-13 02:16:35 +08:00
committed by GitHub
parent bac904565f
commit a1e7fa362a
4 changed files with 23 additions and 6 deletions

View File

@@ -278,10 +278,10 @@ class ParallelConfig:
)
if self.enable_eplb:
if not current_platform.is_cuda():
if not current_platform.is_cuda_alike():
raise ValueError(
"Expert parallelism load balancing is only supported on "
"CUDA devices now."
"CUDA devices or ROCm devices now."
)
if not self.enable_expert_parallel:
raise ValueError("enable_expert_parallel must be True to use EPLB.")