Cyrus Leung 5a4802588e [Misc] Further clean up chunked prefill and prefix caching init (#29186) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2025-11-22 19:34:15 +08:00

..

__init__.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

cache.py

[Misc] Further clean up chunked prefill and prefix caching init (#29186)

2025-11-22 19:34:15 +08:00

compilation.py

[BugFix] Fix Eagle IndexError: list index out of range for even num_speculative_tokens (#29102)

2025-11-22 00:47:05 +00:00

device.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ec_transfer.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

kv_events.py

[Feature] publisher default set zmq in kv_event config (#26915)

2025-10-22 19:19:33 +00:00

kv_transfer.py

Fix typo in ValueError message: use kv_role instead of kv_disagg_role (#27166)

2025-10-19 19:47:19 +00:00

load.py

[Docs] add runai_streamer_sharded to LoadConfig (#27937)

2025-11-03 20:35:16 +00:00

lora.py

[LoRA][2/2]Remove LoRA extra vocab (#28545)

2025-11-21 09:46:43 +08:00

model.py

Default model load/config/tokenizer to mistral format if relevant files exist (#28659)

2025-11-21 13:58:59 -08:00

multimodal.py

[BugFix] Fix mm_encoder_attn_backend arg type checking (#28599)

2025-11-13 03:06:03 +00:00

observability.py

[Feature]: Use pydantic validation in observability.py config (#26637)

2025-10-15 16:44:03 +00:00

parallel.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

pooler.py

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524)

2025-10-30 12:13:05 +00:00

scheduler.py

[V0 Deprecation] Remove num_lookahead_slots (#29000)

2025-11-20 06:39:10 +00:00

speculative.py

[Misc] Move dynamic seed initialization to EngineArgs (#29165)

2025-11-21 15:27:44 +00:00

speech_to_text.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

structured_outputs.py

[Core] add support for reasoning parser plugins (#28075)

2025-11-06 01:15:06 +08:00

utils.py

[torch.compile] caching of config fields should be opt-out by default (#26468)

2025-11-19 06:13:54 -08:00

vllm.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00