biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[CI/Build] Drop Python 3.8 support (#10038)

Browse Source 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Russell Bryant
2024-11-06 09:31:01 -05:00
committed by GitHub
parent 399c798608
commit 098f94de42
8 changed files with 11 additions and 18 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
vllm/distributed/parallel_state.py
View File

@@ -89,12 +89,11 @@ def _get_unique_name(name: str) -> str:
return newname
_groups: Dict[str, Callable[[], "GroupCoordinator"]] = {}
_groups: Dict[str, Callable[[], Optional["GroupCoordinator"]]] = {}
def _register_group(group: "GroupCoordinator") -> None:
# looks like Python 3.8 does not understand `ReferenceType`
_groups[group.unique_name] = weakref.ref(group) # type: ignore
_groups[group.unique_name] = weakref.ref(group)
if supports_custom_op():