Ranran dc6908ac6a [Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) ...

Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

2026-03-23 18:31:14 -04:00

..

attention

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007)

2026-03-23 18:31:14 -04:00

core

fix: disambiguate multimodal prefix cache keys (#36708)

2026-03-20 10:33:20 +08:00

engine

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

executor

elastic_ep: Fix issues with repeated scale up/down cycles (#37131)

2026-03-20 23:13:02 +00:00

kv_offload

Fix KV Offloading + MLA AssertionError by using num_kv_heads=1 in cpu… (#37536)

2026-03-19 12:05:07 +00:00

metrics

[Metrics] Some small refactoring for better maintainability (#33898)

2026-03-20 16:11:34 +00:00

pool

[Refactor] Remove dead code in pooling model (#37572)

2026-03-20 07:39:43 +08:00

sample

[Perf] Optimize top-k search in apply_top_k_top_p_triton sampler (#37225)

2026-03-17 11:35:17 -07:00

spec_decode

[Async][Spec Decoding] Zero-bubble async scheduling + spec decoding (#32951)

2026-03-23 15:37:22 -04:00

structured_output

[MISC] fix pin_memory=torch.cuda.is_available(), use is_pin_memory_available (#37415)

2026-03-19 09:23:24 +00:00

worker

[Async][Spec Decoding] Zero-bubble async scheduling + spec decoding (#32951)

2026-03-23 15:37:22 -04:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

kv_cache_interface.py

[BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219)

2026-03-10 03:32:20 -07:00

outputs.py

[KVConnector] Support worker -> scheduler metadata (#31964)

2026-03-11 17:36:37 +00:00

request.py

[Deprecation][1/2] Remove items deprecated in v0.18 (#36470)

2026-03-09 03:43:23 -07:00

serial_utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00