Victor Ziliang Peng f1599ca55d feat(metrics): Add prefill KV compute metric excluding cached tokens (#30189) ...

Signed-off-by: Ziliang Peng <ziliang@character.ai>

2025-12-09 00:08:48 +00:00

..

attention

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

core

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

cudagraph

[ROCm][CI] Fix test_cudagraph_mode.py Failure For AMD CI (#29808)

2025-12-02 22:54:36 +00:00

determinism

[Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345)

2025-11-26 09:38:52 -07:00

distributed

Mark DBO test as flaky on b200 for Distributed B200 test (#29913)

2025-12-04 10:38:03 -05:00

e2e

[ROCm][CI] Fix test_max_len.py for Rocm (#29916)

2025-12-08 16:58:30 -05:00

ec_connector

[Bugfix] Fix pre-commit (#29601)

2025-11-27 02:23:06 -08:00

engine

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

entrypoints

[Misc] Various cleanups for MM input processing (#29970)

2025-12-04 06:22:20 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[Disagg] Support large batch size in proxy server and update NixlConnector doc for DP (#28782)

2025-12-09 00:01:08 +00:00

kv_offload

[ROCm][CI] Fix test_cpu_offloading for ROCm (#29548)

2025-11-27 07:54:44 +00:00

logits_processors

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

metrics

feat(metrics): Add prefill KV compute metric excluding cached tokens (#30189)

2025-12-09 00:08:48 +00:00

sample

[CI] Fix Bad_words test for tokenizer encode/decode asymmetry (#28193)

2025-12-02 00:02:12 -08:00

shutdown

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

spec_decode

[ROCm][CI] Fix test_max_len.py for Rocm (#29916)

2025-12-08 16:58:30 -05:00

structured_output

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

tpu

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00