Cyrus Leung cbbae38f93 [2/N] Move cache factories to MM registry (#32382) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2026-01-15 01:02:30 -08:00

..

attention

[4/N][Attention] Move MLA common to model_executor (#32060)

2026-01-13 09:08:45 -08:00

core

[BugFix] Assign page_size_padded when unifying kv cache spec. (#32283)

2026-01-14 20:10:01 +00:00

cudagraph

Remove all2all backend envvar (#30363)

2025-12-18 19:46:28 +00:00

determinism

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

distributed

[BugFix] Add spec-decode-incompatible request param validation (#31982)

2026-01-09 00:08:21 +00:00

e2e

[3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054)

2026-01-12 09:13:56 -08:00

ec_connector

[Misc] Introduce encode_*_url utility function (#31208)

2025-12-23 13:45:21 +00:00

engine

[2/N] Move cache factories to MM registry (#32382)

2026-01-15 01:02:30 -08:00

entrypoints

[ROCm][CI] Disable async scheduling on ROCm for test_structured_output[meta-llama/Meta-Llama-3.1-8B-Instruct-xgrammar-auto-speculative_config9] (#32355)

2026-01-15 04:53:43 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[NIXL][Bugfix] Failure logging overhaul + early metadata free on failure (#32031)

2026-01-12 20:38:49 +00:00

kv_offload

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

2026-01-12 15:00:43 +00:00

logits_processors

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

metrics

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

sample

[Cleanup] Remove obsolete spec decoding compatibility logic (#32003)

2026-01-09 05:44:18 +00:00

shutdown

[CI/Build][Hardware][AMD] Fix v1/shutdown (#31997)

2026-01-15 04:01:42 +00:00

spec_decode

[3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054)

2026-01-12 09:13:56 -08:00

structured_output

[BugFix] Fix async scheduling + reasoning with struct output (#31332)

2025-12-25 23:01:02 +00:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00