Boyuan Feng ca683a2a72 use combo kernel to fuse qk-norm and qk-rope (#26682) ...

Signed-off-by: Boyuan Feng <boyuan@meta.com>

2025-10-14 09:40:59 -04:00

..

__init__.py

Tidy vllm/config/__init__.py to only add classes and functions (#26405)

2025-10-08 07:10:00 -07:00

cache.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

compilation.py

use combo kernel to fuse qk-norm and qk-rope (#26682)

2025-10-14 09:40:59 -04:00

device.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_events.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

kv_transfer.py

[NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556)

2025-10-14 09:46:05 +00:00

load.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

lora.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

model.py

[DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864)

2025-10-14 13:07:50 +00:00

multimodal.py

[FEATURE]: Use pydantic validation in multimodal.py config (#26629)

2025-10-13 07:56:59 -07:00

observability.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

parallel.py

[UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732)

2025-10-13 18:12:52 -07:00

pooler.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

scheduler.py

scheduler.py: Update the name of the default scheduler. (#26758)

2025-10-14 06:52:21 +00:00

speculative.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

speech_to_text.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

structured_outputs.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

utils.py

Upgrade Pydantic to v2.12.0 and remove hack for Python 3.13 (#26481)

2025-10-09 06:02:40 -07:00

vllm.py

[Feature] Change vllm.py with pydantic validation (#26726)

2025-10-14 12:00:54 +00:00