Ekagra Ranjan e71b8e210d [Spec Decode] Add Batch Parallel Ngram. Upto 8x lower overhead. (#24986) ...

Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

2025-09-25 15:22:03 -07:00

..

attention

[V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489)

2025-09-25 17:37:50 +00:00

core

[Core] Use KVCacheBlock as much as possible instead of dict[block_id, KVCacheBlock] (#24830)

2025-09-23 15:11:14 -07:00

cudagraph

[V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489)

2025-09-25 17:37:50 +00:00

e2e

[V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489)

2025-09-25 17:37:50 +00:00

engine

[V0 Deprecation] Remove async_output_proc, preemption mode, delay factor (#25334)

2025-09-21 08:52:32 -07:00

entrypoints

Improve output when failing json.loads() on structured output test (#25483)

2025-09-23 18:03:31 -06:00

executor

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

kv_connector

[Docs] NixlConnector quickstart guide (#24249)

2025-09-23 14:23:22 +00:00

kv_offload

[KV offload][5/N] Add CPUOffloadingSpec (#24251)

2025-09-22 12:30:36 -07:00

logits_processors

[V1] Logits processor docs (#22919)

2025-09-17 11:53:12 -07:00

metrics

[Misc] Have AsyncLLM custom_stat_loggers extend default logger list (#20952)

2025-09-04 14:25:30 -07:00

sample

[mypy] Fix wrong type annotations related to tuple (#25660)

2025-09-25 13:00:45 +00:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Spec Decode] Add Batch Parallel Ngram. Upto 8x lower overhead. (#24986)

2025-09-25 15:22:03 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[TPU][Bugfix] fix the missing apply_model in tpu worker (#25526)

2025-09-24 05:18:08 +00:00

tracing

[V0 Deprecation] Remove V0 Tracing & Metrics tests (#25115)

2025-09-17 19:40:44 -07:00

worker

[BugFix] Fix OOM in vLLM replicas by ensuring consistent NCCL memory accounting (#25359)

2025-09-23 15:49:09 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[V0 deprecation] Remove platform v1 controling interface (#25410)

2025-09-23 01:48:12 +00:00

test_external_lb_dp.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

test_hybrid_lb_dp.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

test_internal_lb_dp.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

test_kv_sharing.py

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489)

2025-09-25 17:37:50 +00:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00