Luka Govedič 2915268369 [fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441) ...

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Richard Zou <zou3519@gmail.com>
(cherry picked from commit 15f40b20aa)

2026-02-02 00:14:07 -08:00

..

basic_correctness

[refactor] refactor memory constants usage (#31865)

2026-01-07 18:37:31 +00:00

benchmarks

[Benchmark] Share data between SLA runs (#32184)

2026-01-13 01:12:22 +08:00

compile

[fix][torch.compile] Fix cold-start compilation time increase by adding kv cache update to splitting ops (#33441)

2026-02-02 00:14:07 -08:00

config

[fix] add VLLM_OBJECT_STORAGE_SHM_BUFFER_NAME to compile factors (#32912)

2026-01-23 22:53:10 +00:00

cuda

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

detokenizer

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[Core] Cleanup shm based object store on engine shutdown (#32429)

2026-01-20 08:53:37 +00:00

engine

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

entrypoints

[Bugfix] Fix Qwen3-VL-Reranker load. (#33298)

2026-02-02 00:13:12 -08:00

evals

[Tests] Remove Duplicates (#33032)

2026-01-26 05:23:54 +00:00

kernels

[Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366)

2026-02-02 00:13:45 -08:00

lora

[Feat] allow inplace loading lora (#31326)

2026-01-20 10:15:20 +08:00

model_executor

[Kernel] Add topk_sigmoid kernel (#31246)

2026-01-21 22:49:51 +00:00

models

[Models] Kimi-K2.5 (#33131)

2026-01-28 02:16:28 -08:00

multimodal

[3/N] Group together media-related code (#32406)

2026-01-15 11:52:12 +00:00

plugins

[Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955)

2026-01-26 15:00:28 +08:00

plugins_tests

[Misc] Fix Current vLLM config is not set. warnings, assert to avoid issues in the future (#31747)

2026-01-08 15:20:49 -08:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141)

2026-01-22 13:29:57 -07:00

reasoning

[Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240)

2026-01-13 13:01:39 +00:00

renderers

[Frontend] Introduce Renderer for processing chat messages (using ModelConfig) (#30200)

2026-01-22 12:44:22 +00:00

rocm/aiter

[Bugfix][Hardware][AMD] Fix exception types in AITER MLA FP8 check (#31177)

2026-01-06 14:10:59 +08:00

samplers

[Tests] Clarify pytest skip reasons with actionable context (#32981)

2026-01-24 06:38:50 +00:00

standalone_tests

[ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979)

2025-12-23 22:42:30 -08:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

[Model] Add Grok-2 (#31847)

2026-01-08 04:59:48 -08:00

tool_parsers

[Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240)

2026-01-13 13:01:39 +00:00

tool_use

[Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240)

2026-01-13 13:01:39 +00:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

transformers_utils

[Chore]: Reorganize gguf utils funtions under transformers_utils (#29891)

2025-12-02 17:33:23 +00:00

utils_

[Model] Extend collect_children and no_init_weights contexts (#32757)

2026-01-22 08:20:27 +00:00

v1

Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241)

2026-01-28 11:44:59 -08:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[Quantization][Deprecation] Deprecate HQQ (#32681)

2026-01-21 09:32:40 -05:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[3/N] Group together media-related code (#32406)

2026-01-15 11:52:12 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[Bugfix] Replace PoolingParams.normalize with use_activation (#32243)

2026-01-13 10:45:42 +00:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289)

2025-12-10 14:13:01 -05:00

test_inputs.py

[Frontend] Introduce Renderer for processing chat messages (using ModelConfig) (#30200)

2026-01-22 12:44:22 +00:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Bugfix] Replace PoolingParams.normalize with use_activation (#32243)

2026-01-13 10:45:42 +00:00

test_regression.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

[Tests] Standardize RNG seed utility across test files (#32982)

2026-01-24 06:47:14 +00:00