Patrick von Platen b038d9c40c [Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367) ...

Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

2025-10-17 08:24:42 -07:00

..

attention

[small][batch invariance] Rename the env and internal flags to simplify usage (#26855)

2025-10-16 21:40:25 +00:00

core

[Docs] Replace rst style double-backtick with md single-backtick (#27091)

2025-10-17 02:47:34 -07:00

engine

[Data-parallel] Allow DP>1 for world_size > num_gpus on node (8) (#26367)

2025-10-17 08:24:42 -07:00

executor

[Chore] Separate out vllm.utils.importlib (#27022)

2025-10-17 00:48:59 +00:00

kv_offload

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

metrics

[Misc][DP] support customized aggregated logger for dp (#24354)

2025-10-13 17:45:59 -07:00

pool

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sample

[Kernel] Lazy import FlashInfer (#26977)

2025-10-17 04:48:18 +00:00

spec_decode

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

structured_output

[Chore] Separate out vllm.utils.importlib (#27022)

2025-10-17 00:48:59 +00:00

worker

[Docs] Replace rst style double-backtick with md single-backtick (#27091)

2025-10-17 02:47:34 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change compilation level to compilation mode, deprecation compilation level (#26355)

2025-10-15 02:51:16 +00:00

kv_cache_interface.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

outputs.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

request.py

[Core] Streamline some structured output related code (#26737)

2025-10-14 23:27:44 +00:00

serial_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

utils.py

[WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836)

2025-10-14 23:51:54 +00:00