[distributed][misc] error on same VLLM_HOST_IP setting (#7756)
This commit is contained in:
@@ -137,7 +137,10 @@ environment_variables: Dict[str, Callable[[], Any]] = {
|
||||
os.path.join(get_default_cache_root(), "vllm"),
|
||||
)),
|
||||
|
||||
# used in distributed environment to determine the master address
|
||||
# used in distributed environment to determine the ip address
|
||||
# of the current node, when the node has multiple network interfaces.
|
||||
# If you are using multi-node inference, you should set this differently
|
||||
# on each node.
|
||||
'VLLM_HOST_IP':
|
||||
lambda: os.getenv('VLLM_HOST_IP', "") or os.getenv("HOST_IP", ""),
|
||||
|
||||
|
||||
Reference in New Issue
Block a user