Qiu 2fd893b4ce [Feature] Prefill Context Parallel (PCP) basic support (#28718) ...

Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2025-11-19 15:52:44 -05:00

..

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

cpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

cpu_worker.py

[HARDWARE][CPU] Add Option for Disabling Binding to Specific CPU Cores (#27953)

2025-11-06 23:47:11 +08:00

dp_utils.py

[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for device selection on cuda-like devices (#27564)

2025-10-30 11:41:44 -04:00

ec_connector_model_runner_mixin.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

gpu_input_batch.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

gpu_model_runner.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

gpu_ubatch_wrapper.py

[Chore] Separate out optional dependency checks from vllm.utils (#27207)

2025-10-22 10:44:21 -04:00

gpu_worker.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

kv_connector_model_runner_mixin.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

lora_model_runner_mixin.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_input_batch.py

[Bugfix][LoRA][Spec Decode] Support LoRA with speculative decoding (#21068)

2025-11-08 01:58:22 +00:00

tpu_model_runner.py

[Redo] #26368 (#28771)

2025-11-14 22:47:41 -08:00

tpu_worker.py

[Core] Async scheduling + structured outputs compatibility (#26866)

2025-11-01 00:35:04 +00:00

ubatch_utils.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ubatching.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

utils.py

Rename clashing method names for vLLM model protocol (#27583)

2025-11-12 19:14:33 -08:00

worker_base.py

[V1] Support MP Executor for multi node distributed inference (#23691)

2025-11-16 09:01:21 +00:00

xpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

xpu_worker.py

use default CCL_ZE_IPC_EXCHANGE (#28700)

2025-11-14 16:55:29 +08:00