knlnguyen1802 378385b90c [EC Connector] Optimize remote cache check in scheduler (#32585) ...

Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>

2026-01-22 03:30:59 +00:00

..

attention

[ModelRunner V2] Don't pin reused flashinfer tensors (#32799)

2026-01-21 13:17:43 -08:00

core

[EC Connector] Optimize remote cache check in scheduler (#32585)

2026-01-22 03:30:59 +00:00

engine

[Core] Cleanup shm based object store on engine shutdown (#32429)

2026-01-20 08:53:37 +00:00

executor

[TPU][Core] Enable Pipeline Parallelism on TPU backend (#28506)

2026-01-16 15:29:20 -08:00

kv_offload

OffloadingConnector: Prevent redundant loads (#29087)

2026-01-21 01:15:42 +00:00

metrics

[Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661)

2026-01-20 12:28:41 +00:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[ROCm][Bugfix] Disable hip sampler to fix deepseek's accuracy issue on ROCm (#32413)

2026-01-15 16:35:47 +00:00

spec_decode

[Bugfix] Fix potential EAGLE spec decode segfault during graph capture (#32818)

2026-01-22 03:11:55 +00:00

structured_output

[Bugfix] Fix byte fallback handling when using outlines (#31391)

2026-01-20 19:48:08 +00:00

worker

[Model Runner V2] Do not error on attention backends (#32820)

2026-01-21 17:02:48 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Misc] Remove pad_for_cudagraphs from config (#30143)

2026-01-20 15:05:48 -05:00

kv_cache_interface.py

Decouple page_size_bytes calculation in AttentionSpec for TPU/RPA Compatibility. (#31635)

2026-01-08 09:00:07 +00:00

outputs.py

[perf][async] support non cpu sync get logprob tensors for spec (#31336)

2026-01-09 21:24:51 +00:00

request.py

[BugFix] scheduler: Fix resuming of preempted requests after async load (#31583)

2026-01-10 12:39:25 -08:00

serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

[Feature] Add iteration level logging and enhance nvtx marker (#31193)

2026-01-09 00:13:39 +00:00