biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Chore] Separate out vllm.utils.network_utils (#27164)

Browse Source 
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
This commit is contained in:
iAmir97
2025-10-19 17:06:32 +07:00
committed by GitHub
parent 221bf72577
commit 7a6c8c3fa1
37 changed files with 516 additions and 487 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/offline_inference/rlhf.py
View File

@@ -38,7 +38,7 @@ from rlhf_utils import stateless_init_process_group
from transformers import AutoModelForCausalLM
from vllm import LLM, SamplingParams
from vllm.utils import get_ip, get_open_port
from vllm.utils.network_utils import get_ip, get_open_port
class MyLLM(LLM):