Nick Hill 44822d7ff2 [BugFix] Preserve spec decoding uniform decode when scheduling (#29759) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-12-01 17:15:52 -08:00

..

attention

[v1] Add real sliding window calculation to FlexAttention direct BlockMask building (#26015)

2025-12-01 13:12:51 +00:00

core

[Core][Observability] Add KV cache residency metrics (#27793)

2025-12-01 18:27:53 +00:00

cudagraph

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847)

2025-11-27 01:55:58 -08:00

determinism

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345)

2025-11-26 09:38:52 -07:00

distributed

[BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698)

2025-11-28 20:19:01 -08:00

e2e

[BugFix] Preserve spec decoding uniform decode when scheduling (#29759)

2025-12-01 17:15:52 -08:00

ec_connector

[Bugfix] Fix pre-commit (#29601)

2025-11-27 02:23:06 -08:00

engine

[Misc] Refactor tokenizer interface (#29693)

2025-11-29 04:02:21 -08:00

entrypoints

[Misc] Unify tokenizer registration (#29767)

2025-12-01 11:34:58 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

kv_offload

[ROCm][CI] Fix test_cpu_offloading for ROCm (#29548)

2025-11-27 07:54:44 +00:00

logits_processors

[Bugfix] Validate custom logits processor xargs for online serving (#27560)

2025-11-05 16:53:33 +00:00

metrics

[Metrics] Refactor LoRA state tracking (#26801)

2025-11-10 16:34:36 +08:00

sample

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

shutdown

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

spec_decode

[Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597)

2025-11-28 22:25:05 +00:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

tpu

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

[Attention] Remove imports from vllm/attention/__init__.py (#29342)

2025-11-26 10:53:15 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00