Ilya Markov 237cf6d32a [Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709) ...

Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

2025-10-23 20:58:39 +08:00

..

attention

[BugFix] bugfix for Flash Attention MLA with full cuda graph IMA following pr-25490 (#27128)

2025-10-22 19:36:39 +00:00

core

[Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245)

2025-10-23 12:21:08 +02:00

engine

[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709)

2025-10-23 20:58:39 +08:00

executor

[Chore] Separate out system utilities from vllm.utils (#27201)

2025-10-22 20:25:25 +00:00

kv_offload

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

metrics

[Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245)

2025-10-23 12:21:08 +02:00

pool

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

sample

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

spec_decode

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

structured_output

Updated xgrammar backend to not deny supported string formats (#27253)

2025-10-21 22:25:23 +00:00

worker

[Misc] Remove use of CUDA_VISIBLE_DEVICES for device selection (fix DP slow startup time &c) (#26709)

2025-10-23 20:58:39 +08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[LoRA] LoRA cuda graph specialization (#25914)

2025-10-20 04:21:09 +00:00

kv_cache_interface.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

outputs.py

[V1][spec decode] return logprobs for spec decoding (#26060)

2025-10-22 22:59:59 -07:00

request.py

[Core] Streamline some structured output related code (#26737)

2025-10-14 23:27:44 +00:00

serial_utils.py

[CORE] Support Prefix Caching with Prompt Embeds (#27219)

2025-10-22 22:18:07 -07:00

utils.py

[CORE] Support Prefix Caching with Prompt Embeds (#27219)

2025-10-22 22:18:07 -07:00