vllm/vllm at 0e65818910c4e202d2ea8d7ece8b49c959ae83dc - vllm

assets

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

attention

[DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864 )

2025-10-14 13:07:50 +00:00

benchmarks

Add support for the /rerank endpoint in vllm bench serve (#26602 )

2025-10-14 04:25:43 +00:00

compilation

[compile] Enable sequence parallelism for full cuda graph without specifying compile sizes (#26681 )

2025-10-13 18:15:34 -07:00

config

use combo kernel to fuse qk-norm and qk-rope (#26682 )

2025-10-14 09:40:59 -04:00

device_allocator

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

distributed

[NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556 )

2025-10-14 09:46:05 +00:00

engine

[Chore] Remove SupportsV0Only interface and update supported models docs (#26783 )

2025-10-14 04:55:10 -07:00

entrypoints

[Feature][Responses API] Stream Function Call - harmony (#24317 )

2025-10-14 08:31:43 -07:00

executor

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

inputs

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logging_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

lora

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

model_executor

Added MoE configs for llama 4, H200 device with tp=4/8 tuning (#26837 )

2025-10-14 14:21:03 -07:00

multimodal

[Model] Use merge_by_field_config for MM models (M-N) (#26710 )

2025-10-14 01:27:01 +08:00

platforms

[Plugin] Make plugin group clear (#26757 )

2025-10-14 07:49:59 +00:00

plugins

[Plugin] Make plugin group clear (#26757 )

2025-10-14 07:49:59 +00:00

profiler

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

ray

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

reasoning

[Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027 )

2025-10-13 15:55:20 +08:00

third_party

fix some typos (#24071 )

2025-09-02 20:44:50 -07:00

transformers_utils

[Model][0/N] Improve all pooling task | clean up (#25817 )

2025-10-13 16:44:50 +08:00

triton_utils

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

usage

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

utils

[Log] Optimize Startup Log (#26601 )

2025-10-14 02:06:57 +08:00

v1

[Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146 )

2025-10-14 17:03:21 -04:00

vllm_flash_attn

[BugFix] Fix vllm_flash_attn install issues (#17267 )

2025-04-27 17:27:56 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

_bc_linter.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

_custom_ops.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

_ipex_ops.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

beam_search.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

collect_env.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

connections.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

env_override.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

envs.py

[Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146 )

2025-10-14 17:03:21 -04:00

forward_context.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logger.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logits_process.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

logprobs.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

outputs.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

pooling_params.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509 )

2023-10-30 14:50:47 -07:00

sampling_params.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

scalar_type.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

scripts.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00

sequence.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

tasks.py

[V1] Get supported tasks from model runner instead of model config (#21585 )

2025-07-25 05:36:45 -07:00

test_utils.py

Remove V0 Encoder-Decoder Support (#24907 )

2025-09-15 21:17:14 -07:00

tracing.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633 )

2025-10-12 09:51:31 -07:00

version.py

Convert formatting to use ruff instead of yapf + isort (#26247 )

2025-10-05 07:06:22 -07:00