Nick Hill 26bd43b52d Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262)

2026-03-06 08:28:09 -08:00

..

__init__.py

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730)

2026-03-05 22:04:31 -08:00

async_llm.py

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730)

2026-03-05 22:04:31 -08:00

coordinator.py

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730)

2026-03-05 22:04:31 -08:00

core_client.py

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730)

2026-03-05 22:04:31 -08:00

core.py

Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262)

2026-03-06 08:28:09 -08:00

detokenizer.py

[Frontend] Exploit tokenizers "new stream" in FastIncrementalDetokenizer (#34217)

2026-02-11 11:03:24 +01:00

exceptions.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_processor.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

launch.py

[Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730)

2026-03-05 22:04:31 -08:00

llm_engine.py

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logprobs.py

[ModelRunner V2] Fix spec decoding + logprobs (#33391)

2026-01-31 03:33:26 +00:00

output_processor.py

[Core] Cleanup engine pause/sleep logic (#34528)

2026-02-24 19:33:34 -08:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262)

2026-03-06 08:28:09 -08:00