Shiyan Deng 0a208d1f54 [BugFix] Fix engine hanging after KV cache initialization failure (#35478) ...

Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

2026-03-05 20:58:09 -08:00

..

__init__.py

[Core] Add optional flags to check for repetitive token patterns in engine output (#35451)

2026-03-03 12:23:25 +08:00

async_llm.py

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

coordinator.py

[1/N] Elastic EP Milestone 2 (#34861)

2026-02-28 04:46:42 +00:00

core_client.py

[Bugfix] Improve engine ready timeout error message (#35616)

2026-03-04 05:54:32 +00:00

core.py

[BugFix] Fix engine hanging after KV cache initialization failure (#35478)

2026-03-05 20:58:09 -08:00

detokenizer.py

[Frontend] Exploit tokenizers "new stream" in FastIncrementalDetokenizer (#34217)

2026-02-11 11:03:24 +01:00

exceptions.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

input_processor.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

launch.py

[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551)

2026-03-04 18:41:52 +00:00

llm_engine.py

add io_process_plugin for sparse embedding (#34214)

2026-02-28 09:16:37 +00:00

logprobs.py

[ModelRunner V2] Fix spec decoding + logprobs (#33391)

2026-01-31 03:33:26 +00:00

output_processor.py

[Core] Cleanup engine pause/sleep logic (#34528)

2026-02-24 19:33:34 -08:00

parallel_sampling.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[BugFix] Fix engine hanging after KV cache initialization failure (#35478)

2026-03-05 20:58:09 -08:00