liranschour 8322d4e47f Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) ...

Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

2026-02-05 02:17:02 -08:00

..

basic_correctness

[refactor] refactor memory constants usage (#31865)

2026-01-07 18:37:31 +00:00

benchmarks

[Benchmark] Share data between SLA runs (#32184)

2026-01-13 01:12:22 +08:00

compile

[CI][torch.compile] Reduce e2e fusion test time (#33293)

2026-02-04 19:09:03 -05:00

config

[rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308)

2026-02-04 10:09:14 -08:00

cuda

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

detokenizer

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[Bugfix] Fix torchrun PP broadcast deadlock with async scheduling (#33701)

2026-02-04 02:17:37 +00:00

engine

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

entrypoints

[Refactor] Move task outside of PoolingParams.verify (#33796)

2026-02-05 09:33:11 +00:00

evals

[CI] Add DeepSeek V3.2 nightly eval (#33566)

2026-02-02 16:10:02 +00:00

kernels

[CI][AMD][BugFix] Ensure VLLM_ROCM_USE_AITER is set so test_rocm_aiter_topk.py can run correctly (#33840)

2026-02-05 05:05:48 +00:00

lora

Reduce the kernel overhead when num of active loras is smaller than max loras. Multiple cuda graphs are captured for each num of active-loras. (#32005)

2026-02-02 12:30:06 -05:00

model_executor

[BugFix][Router Replay] Capture Logical Experts with EPLB (#33013)

2026-01-31 10:12:17 -05:00

models

[ROCm][Bugfix][CI] Fix hybrid models and their tests (Mamba/Jamba/Bamba) (#32710)

2026-02-05 10:01:23 +00:00

multimodal

[Refactor] Move MM data parsing outside processor (#33408)

2026-01-31 16:46:14 +00:00

plugins

[Chore] Update type annotation of input_ids in model forward (#33063)

2026-01-26 06:02:10 -08:00

plugins_tests

[Misc] Fix Current vLLM config is not set. warnings, assert to avoid issues in the future (#31747)

2026-01-08 15:20:49 -08:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

reasoning

Remove deprecated reasoning_content message field (#33402)

2026-01-30 11:48:15 +00:00

renderers

[Chore] Remove redundant input parsing methods (#33542)

2026-02-02 10:50:47 +00:00

rocm/aiter

[Bugfix][Hardware][AMD] Fix exception types in AITER MLA FP8 check (#31177)

2026-01-06 14:10:59 +08:00

samplers

[Tests] Clarify pytest skip reasons with actionable context (#32981)

2026-01-24 06:38:50 +00:00

standalone_tests

[ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979)

2025-12-23 22:42:30 -08:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

[Model] Add Grok-2 (#31847)

2026-01-08 04:59:48 -08:00

tool_parsers

[Bugfix] GLM-4 tool parser: incremental string streaming (#33218)

2026-02-02 11:13:31 +08:00

tool_use

[Refactor] [6/N] to simplify the vLLM openai chat_completion serving architecture (#32240)

2026-01-13 13:01:39 +00:00

tools

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

transformers_utils

[UX] Use gguf repo_id:quant_type syntax for examples and docs (#33371)

2026-01-31 12:14:54 +08:00

utils_

[Refactor] Clean up pooling serial utils (#33665)

2026-02-03 10:29:18 +00:00

v1

Enable Cross layers KV cache layout at NIXL Connector V2 (#33339)

2026-02-05 02:17:02 -08:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[Nightly CI] Remove CT Model (#33530)

2026-02-01 19:09:09 -08:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[QeRL] Layerwise Reloading (#32133)

2026-01-30 08:50:05 -07:00

test_access_log_filter.py

[Logging] add --disable-access-log-for-endpoints CLI option (#30011)

2026-01-26 21:49:03 +00:00

test_attention_backend_registry.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_config.py

[CI][torch.compile] Reduce e2e fusion test time (#33293)

2026-02-04 19:09:03 -05:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289)

2025-12-10 14:13:01 -05:00

test_inputs.py

[Frontend] Use new Renderer for Completions and Tokenize API (#32863)

2026-01-31 04:51:15 -08:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Refactor] Move task outside of PoolingParams.verify (#33796)

2026-02-05 09:33:11 +00:00

test_regression.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

[CI][Bugfix]: return McpCall for built-in MCP tools in non-streaming mode (#32762)

2026-02-05 11:14:06 +08:00