biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix] Fix AttributeError in SMControlContextManager (#35338)

Browse Source 
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
This commit is contained in:
Lucas Wilkinson
2026-02-25 21:01:10 -05:00
committed by GitHub
parent de527e1cec
commit 9511a3f8ee
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/v1/worker/gpu_ubatch_wrapper.py
View File

@@ -74,7 +74,7 @@ class SMControlContextManager:
"SM control is currently only supported on CUDA"
)
total_sms = num_compute_units(torch.cuda.current_device().index)
total_sms = num_compute_units(torch.cuda.current_device())
assert comm_sms < total_sms
self.total_sms = total_sms