DevByteAI 1f214290d6 fix(compile): apply partition wrapper when loading AOT cached functions (#31536) ...

Signed-off-by: Devbyteai <abud6673@gmail.com>
Signed-off-by: DevByteAI <161969603+devbyteai@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2026-01-08 17:27:26 +08:00

..

basic_correctness

[refactor] refactor memory constants usage (#31865)

2026-01-07 18:37:31 +00:00

benchmarks

[UX] Make vllm bench serve discover model by default and use --input-len (#30816)

2025-12-17 01:55:30 -08:00

compile

fix(compile): apply partition wrapper when loading AOT cached functions (#31536)

2026-01-08 17:27:26 +08:00

config

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

cuda

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

detokenizer

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[EPLB] Optimize EPLB with numpy (#29499)

2026-01-07 15:21:35 -05:00

engine

Add --max-model-len auto to auto-fit context to available memory (#29431)

2025-12-23 21:37:14 -08:00

entrypoints

[grpc] Support gRPC server entrypoint (#30190)

2026-01-07 23:24:46 -08:00

evals

[MoE Refactor][15/N] Apply Refactor to Fp8 (#31415)

2026-01-07 19:42:33 -05:00

kernels

[MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692)

2026-01-08 03:46:27 +00:00

lora

[Platform] Deprecate seed_everything (#31659)

2026-01-04 18:34:04 -08:00

model_executor

[Chore] Try remove init_cached_hf_modules (#31786)

2026-01-07 12:34:04 +08:00

models

[Models] Allow converting Qwen3-VL into Reranker model (#31890)

2026-01-08 08:10:15 +00:00

multimodal

[Fix] Enable mm_processor_cache with vision LoRA (#31927)

2026-01-08 15:31:51 +08:00

plugins

[v1] Add PrefixLM support to FlexAttention backend (#27938)

2025-12-07 15:51:36 +00:00

plugins_tests

[Frontend] Resettle pooling entrypoints (#29634)

2025-12-01 15:30:43 +08:00

prompts

[BugFix] Fix input positions for long context with sliding window (#2088)

2023-12-13 12:28:13 -08:00

quantization

[ROCm]Skip test_torchao.py::test_pre_quantized_model on CDNA3 arch (#31905)

2026-01-08 15:47:44 +08:00

reasoning

[Chore] Adjust tokenizer import to avoid circular imports (#30601)

2025-12-13 04:42:39 -08:00

rocm/aiter

[Bugfix][Hardware][AMD] Fix exception types in AITER MLA FP8 check (#31177)

2026-01-06 14:10:59 +08:00

samplers

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

standalone_tests

[ROCm][CI] Fix entrypoints tests and Python-only installation test on ROCm (#28979)

2025-12-23 22:42:30 -08:00

system_messages

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

tokenizers_

[CI Failure] Disable mosaicml/mpt-7b and databricks/dbrx-instruct tests (#31182)

2025-12-22 15:40:35 -08:00

tool_parsers

fix: update kimi k2 tool parser logic (#31207)

2025-12-30 10:01:58 +08:00

tool_use

[Bugfix][Frontend] Prevent IndexError in MiniMax M2 tool parser during streaming extraction (#30555)

2025-12-17 16:37:57 +08:00

tools

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

transformers_utils

[Chore]: Reorganize gguf utils funtions under transformers_utils (#29891)

2025-12-02 17:33:23 +00:00

utils_

use the same stream for cuda graph catpure and replay for NCCL (#29207)

2025-12-25 19:10:03 +08:00

v1

[CI/Build] Enable test_kv_cache_events_dp for AMD (#31834)

2026-01-08 09:00:24 +00:00

vllm_test_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

weight_loading

[ROCm][CI] Fix Weight Loading With Multiple GPU Tests on ROCm (#28984)

2025-11-19 21:31:33 +00:00

__init__.py

[Small] Formatter only checks lints in changed files (#1528)

2023-10-31 15:39:38 -07:00

ci_envs.py

[Model][0/N] Improve all pooling task | clean up (#25817)

2025-10-13 16:44:50 +08:00

conftest.py

[Model] Nemotron Parse 1.1 Support (#30864)

2026-01-05 13:00:14 -08:00

test_attention_backend_registry.py

[Bugfix] fix the alias bug of AttentionBackendEnum when register CUSTOM attention backend to vllm (#30869)

2025-12-20 09:03:35 +08:00

test_config.py

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

test_embedded_commit.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_envs.py

[Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289)

2025-12-10 14:13:01 -05:00

test_inputs.py

Improve parse_raw_prompt test cases for invalid input .v2 (#30512)

2025-12-14 11:18:41 +08:00

test_logger.py

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

2025-12-02 07:49:16 +00:00

test_logprobs.py

[Core] Switch Flat logprob control from environment variable to SamplingParams (#28914)

2025-11-19 02:10:02 +00:00

test_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_pooling_params.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

test_regression.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_routing_simulator.py

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891)

2025-12-20 18:22:04 +00:00

test_scalartype.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_seed_behavior.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_sequence.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_triton_utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_vllm_port.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

[CI] Add Qwen3-Next-FP8 to Blackwell model tests (#31049)

2025-12-23 17:21:50 -08:00