Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
This commit is contained in:
Wang Ran (汪然)
2023-09-28 07:22:45 +08:00
committed by GitHub
parent 21877b0d75
commit 30e775281d
2 changed files with 5 additions and 6 deletions

View File

@@ -54,8 +54,8 @@ class LLMEngine:
scheduler_config: The configuration related to the request scheduler.
distributed_init_method: The initialization method for distributed
execution. See `torch.distributed.init_process_group` for details.
stage_devices: The list of devices for each stage. Each stage is a list
of (rank, node_resource, device) tuples.
placement_group: Ray placement group for distributed execution.
Required for distributed execution.
log_stats: Whether to log statistics.
"""