override_pooler_config
disable_log_requests
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
CompilationConfig.use_inductor
Optional[x]
x | None
Union[x, y]
x | y
kv_role
kv_disagg_role
xformers
ParallelConfig
num_lookahead_slots
EngineArgs