[Doc]: fix typos in Python comments (#24173)
Signed-off-by: Didier Durand <durand.didier@gmail.com> Co-authored-by: Russell Bryant <rbryant@redhat.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
This commit is contained in:
@@ -717,7 +717,7 @@ class AsyncLLMEngine(EngineClient):
|
||||
# Stop the execute model loop in parallel workers until there
|
||||
# are more requests to process. This avoids waiting
|
||||
# indefinitely in torch.distributed ops which may otherwise
|
||||
# timeout, and unblocks the RPC thread in the workers so that
|
||||
# time out, and unblocks the RPC thread in the workers so that
|
||||
# they can process any other queued control plane messages,
|
||||
# such as add/remove lora adapters.
|
||||
await engine.engine.stop_remote_worker_execution_loop_async()
|
||||
|
||||
Reference in New Issue
Block a user