Yifan Qiao 52bf066516 [Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166) ...

Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>

2025-12-26 18:25:46 -08:00

..

attention

[Mamba] - Consolidate Mambas Attention Logic (#28133)

2025-12-23 21:57:00 +01:00

core

[Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166)

2025-12-26 18:25:46 -08:00

engine

[Core] Initialize LoRA support for tower and connector in multi-modal models (#26674)

2025-12-26 04:48:20 -08:00

executor

[Logs] Optimize startup logs 4 (#29903)

2025-12-13 16:12:53 -05:00

kv_offload

CPU KV Offloading: Use more CUDA streams (#29013)

2025-12-14 23:50:45 +00:00

metrics

[Metrics] Model FLOPs Utilization estimation (#30738)

2025-12-18 01:40:51 +00:00

pool

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

sample

[BugFix] Fix logprobs with spec decode and modified logits (#30846)

2025-12-18 19:58:28 -08:00

spec_decode

[SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845)

2025-12-22 13:06:10 -08:00

structured_output

[BugFix] Fix async scheduling + reasoning with struct output (#31332)

2025-12-25 23:01:02 +00:00

worker

[Core][Hybrid allocator + connector] Support hybrid allocator + kv cache connector (#30166)

2025-12-26 18:25:46 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[BugFix] Fix assert batch_descriptor.num_tokens == num_tokens_padded (#30173)

2025-12-09 10:36:12 -05:00

kv_cache_interface.py

Correct position of docstring of class attributes (#31209)

2025-12-23 02:08:58 -08:00

outputs.py

[KVConnector] Add KV events to KV Connectors (#28309)

2025-12-11 15:30:29 +01:00

request.py

[Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475)

2025-12-16 14:18:17 -08:00

serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00