Tomas Ruiz 4a5299c93f feat: spec decode with draft models (#24322) ...

Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>

2026-01-19 16:05:46 -05:00

..

attention

[BUGFIX] Fix test_mla_backends.py. Scale MLA projection weights to prevent numerical instability (#32529)

2026-01-19 13:49:29 -05:00

core

[Feature] Support async scheduling + PP (#32359)

2026-01-15 12:06:23 -05:00

cudagraph

Remove all2all backend envvar (#30363)

2025-12-18 19:46:28 +00:00

determinism

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

distributed

[ROCm][CI] Add ROCm attention backend support for EAGLE DP tests (#32363)

2026-01-19 09:57:54 +00:00

e2e

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

ec_connector

[Misc] Introduce encode_*_url utility function (#31208)

2025-12-23 13:45:21 +00:00

engine

[2/N] Move cache factories to MM registry (#32382)

2026-01-15 01:02:30 -08:00

entrypoints

[ROCm][CI] Disable async scheduling on ROCm for test_structured_output[meta-llama/Meta-Llama-3.1-8B-Instruct-xgrammar-auto-speculative_config9] (#32355)

2026-01-15 04:53:43 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[UX] Use kv_offloading_backend=native by default (#32421)

2026-01-15 18:55:11 +00:00

kv_offload

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

2026-01-12 15:00:43 +00:00

logits_processors

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

metrics

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

sample

[Cleanup] Remove obsolete spec decoding compatibility logic (#32003)

2026-01-09 05:44:18 +00:00

shutdown

[CI/Build][Hardware][AMD] Fix v1/shutdown (#31997)

2026-01-15 04:01:42 +00:00

spec_decode

[3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054)

2026-01-12 09:13:56 -08:00

structured_output

[Refactor] [11/N] to simplify the mcp architecture (#32396)

2026-01-15 18:49:31 +08:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00