[Bugfix][CI] fix typos (#34934)
Signed-off-by: 1195343015 <1195343015@qq.com> Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com> Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
This commit is contained in:
@@ -1520,7 +1520,7 @@ environment_variables: dict[str, Callable[[], Any]] = {
|
||||
os.getenv("VLLM_DEEPEP_BUFFER_SIZE_MB", "1024")
|
||||
),
|
||||
# Force DeepEP to use intranode kernel for inter-node communication in
|
||||
# high throughput mode. This is useful archive higher prefill throuhgput
|
||||
# high throughput mode. This is useful archive higher prefill throughput
|
||||
# on system supports multi-node nvlink (e.g GB200).
|
||||
"VLLM_DEEPEP_HIGH_THROUGHPUT_FORCE_INTRA_NODE": lambda: bool(
|
||||
int(os.getenv("VLLM_DEEPEP_HIGH_THROUGHPUT_FORCE_INTRA_NODE", "0"))
|
||||
|
||||
Reference in New Issue
Block a user