Aurick Qiao 2c19d96777 [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) ...

Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>

2025-11-03 09:23:31 -08:00

..

attention

Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663)

2025-10-31 11:12:19 -07:00

core

[BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728)

2025-11-03 10:08:08 +08:00

cudagraph

[CI] Add tests for cudagraph (#27391)

2025-10-25 02:37:33 +00:00

distributed

[CI/Testing] Add basic single node dual batch overlap test (#27235)

2025-11-03 17:00:46 +00:00

e2e

[Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784)

2025-11-03 09:23:31 -08:00

engine

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

entrypoints

[CI] Fix flaky test_two_responses_with_same_prev_id test (#27745)

2025-10-29 15:10:35 +00:00

executor

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

generation

[Test] Batch Invariant: Unit test using parameterized backend (#27478)

2025-10-28 13:51:35 -07:00

kv_connector

[Add] cmdline argument parsing for KV cache offloading modules (#27621)

2025-11-01 07:17:07 +00:00

kv_offload

[KV offload] Enable CPU KV offload on CUDA alike Platforms (#27770)

2025-10-30 22:10:29 +08:00

logits_processors

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

metrics

[V1][Metrics][Plugin] Add plugin support for custom StatLoggerBase implementations (#22456)

2025-10-18 15:12:46 -07:00

sample

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

shutdown

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

spec_decode

[Speculators] Move tests + fix integration (#27308)

2025-10-29 00:54:21 -07:00

structured_output

Updated xgrammar backend to not deny supported string formats (#27253)

2025-10-21 22:25:23 +00:00

tpu

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00