biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix] Sort hf_weights_files in fastsafetensors_weights_iterator to match #33491 (#34190)

Browse Source 
Signed-off-by: Balaxxe <136368465+jaim12005@users.noreply.github.com>
This commit is contained in:
Balaxxe
2026-02-10 00:06:30 -07:00
committed by GitHub
parent 9608844f96
commit 8d48d0a9d9
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/model_executor/model_loader/weight_utils.py
View File

@@ -826,6 +826,7 @@ def fastsafetensors_weights_iterator(
pg = SingleGroup() pg = SingleGroup()
device = torch.device(f"cuda:{current_platform.current_device()}") device = torch.device(f"cuda:{current_platform.current_device()}")
hf_weights_files = sorted(hf_weights_files, key=_natural_sort_key)
weight_files_sub_lists = [ weight_files_sub_lists = [
hf_weights_files[i : i + pg.size()] hf_weights_files[i : i + pg.size()]
for i in range(0, len(hf_weights_files), pg.size()) for i in range(0, len(hf_weights_files), pg.size())