[Hardware][TPU] Add supports_async_scheduling() method to Executor interface so that it can be extended for Executor implementations. (#36924)

Signed-off-by: Guangxiang Du <gxd@google.com>
This commit is contained in:
gxd3
2026-03-17 21:53:28 -07:00
committed by GitHub
parent f1740006e4
commit a0dd1995c7
5 changed files with 44 additions and 10 deletions

View File

@@ -487,6 +487,10 @@ class MultiprocExecutor(Executor):
* self.parallel_config.prefill_context_parallel_size
)
@classmethod
def supports_async_scheduling(cls) -> bool:
return True
@dataclass
class UnreadyWorkerProcHandle: