biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[BUG] Fix rank calculation in NCCLWeightTransferEngine (#36940)

Browse Source 
Signed-off-by: hao-aaron <ahao@anyscale.com>
This commit is contained in:
Aaron Hao
2026-03-12 18:56:51 -07:00
committed by GitHub
parent 572c776bfb
commit 5e1a373d2e
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/distributed/weight_transfer/nccl_engine.py
View File

@@ -132,7 +132,7 @@ class NCCLWeightTransferEngine(
# Calculate the global rank in the trainer-worker process group
# Must account for data parallel to get unique ranks across all workers
dp_rank = self.parallel_config.data_parallel_rank
dp_rank = self.parallel_config.data_parallel_index
world_size_per_dp = self.parallel_config.world_size # TP * PP
rank_within_dp = self.parallel_config.rank