biondizzle/vllm

Files

dtc 0d6ccf68fa [P/D] rework mooncake connector and introduce its bootstrap server (#31034 )

Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

2026-02-03 08:08:25 -08:00

335 B

Raw Permalink Blame History

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.