Andrew Sansom ff93cc8c84 [CORE] Support Prefix Caching with Prompt Embeds (#27219) ...

Signed-off-by: Andrew Sansom <andrew@protopia.ai>

2025-10-22 22:18:07 -07:00

..

attention

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

core

[CORE] Support Prefix Caching with Prompt Embeds (#27219)

2025-10-22 22:18:07 -07:00

cudagraph

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

distributed

[Bugfix][CI] Fix Distributed Tests (4 GPUs) async_sched+ray test (#27195)

2025-10-20 16:34:54 +00:00

e2e

Update PyTorch to 2.9.0+cu129 (#24994)

2025-10-21 17:20:18 -04:00

engine

[V0 Deprecation] Remove V0 executors (#27142)

2025-10-21 11:09:37 -07:00

entrypoints

[Frontend] Require flag for loading text and image embeds (#27204)

2025-10-22 15:52:02 +00:00

executor

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

generation

[Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127)

2025-10-18 09:28:05 -04:00

kv_connector

[P/D] Dynamic kv_output_aggregator collect size (#26734)

2025-10-22 18:07:58 +02:00

kv_offload

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

logits_processors

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

metrics

[V1][Metrics][Plugin] Add plugin support for custom StatLoggerBase implementations (#22456)

2025-10-18 15:12:46 -07:00

sample

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

shutdown

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

spec_decode

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

structured_output

Updated xgrammar backend to not deny supported string formats (#27253)

2025-10-21 22:25:23 +00:00

tpu

[Chore] Separate out vllm.utils.mem_utils (#27143)

2025-10-18 10:06:59 +00:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

[Chore] Separate out system utilities from vllm.utils (#27201)

2025-10-22 20:25:25 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00