biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix] Skip out-of-stage layers in get_layers_from_vllm_config for pipeline parallel (#36243)

Browse Source 
Signed-off-by: Tushar Shetty <tushar.shetty@abbyy.com>
Signed-off-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
This commit is contained in:
Tushar Shetty
2026-03-09 09:10:16 +05:30
committed by GitHub
parent 747431044d
commit c4d859c274
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/config/vllm.py
View File

@@ -1795,5 +1795,6 @@ def get_layers_from_vllm_config(
return { return {
layer_name: forward_context[layer_name] layer_name: forward_context[layer_name]
for layer_name in layer_names for layer_name in layer_names
if isinstance(forward_context[layer_name], layer_type) if layer_name in forward_context
and isinstance(forward_context[layer_name], layer_type)
} }