elvischenv 5d6ce2b960 [Perf] Support stream interval for reducing host overhead (#27869) ...

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

2025-11-13 13:21:25 -05:00

..

__init__.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

cache.py

[Attention] Refactor CUDA attention backend selection logic (#24794)

2025-11-11 07:40:44 -05:00

compilation.py

[Misc] Turn off encoder torch compile by default (#28634)

2025-11-13 08:38:08 -08:00

device.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ec_transfer.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

kv_events.py

[Feature] publisher default set zmq in kv_event config (#26915)

2025-10-22 19:19:33 +00:00

kv_transfer.py

Fix typo in ValueError message: use kv_role instead of kv_disagg_role (#27166)

2025-10-19 19:47:19 +00:00

load.py

[Docs] add runai_streamer_sharded to LoadConfig (#27937)

2025-11-03 20:35:16 +00:00

lora.py

[V0 deprecation] Remove VLLM_USE_V1 usage in config module (#27784)

2025-10-30 09:42:49 +00:00

model.py

Fix get_num_experts when config sets it explicitly to None (#28652)

2025-11-13 16:02:42 +00:00

multimodal.py

[BugFix] Fix mm_encoder_attn_backend arg type checking (#28599)

2025-11-13 03:06:03 +00:00

observability.py

[Feature]: Use pydantic validation in observability.py config (#26637)

2025-10-15 16:44:03 +00:00

parallel.py

[EPLB][ROCm]: support EPBL for ROCm backend (#27731)

2025-11-12 18:16:35 +00:00

pooler.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

scheduler.py

[Perf] Support stream interval for reducing host overhead (#27869)

2025-11-13 13:21:25 -05:00

speculative.py

Bump arctic-inference requirement (#28174)

2025-11-07 18:31:18 -08:00

speech_to_text.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

structured_outputs.py

[Core] add support for reasoning parser plugins (#28075)

2025-11-06 01:15:06 +08:00

utils.py

[CI/Build] Move pre-commit only scripts to tools/pre_commit (#27657)

2025-10-29 08:04:33 +00:00

vllm.py

Remove deprecated fields from CompilationConfig (#27593)

2025-11-12 16:10:28 +00:00