Matthew Bonanni 60dbf7d8f1 Update batch invariant to use attention config (#30704) ...

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2025-12-15 15:24:16 -05:00

..

gpu

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)

2025-12-09 17:18:10 -08:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

[Bugfix] Fix block size in block_table with PCP (#29094)

2025-11-22 01:34:28 +00:00

cp_utils.py

[Misc][PCP&DCP] relocate PCP feature check (#30050)

2025-12-11 03:36:18 -08:00

cpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

cpu_worker.py

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

dp_utils.py

[BugFix] Fix assert batch_descriptor.num_tokens == num_tokens_padded (#30173)

2025-12-09 10:36:12 -05:00

ec_connector_model_runner_mixin.py

[Doc]: fixing typos in multiple files. (#29685)

2025-11-28 08:41:41 -08:00

gpu_input_batch.py

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

gpu_model_runner.py

[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532)

2025-12-12 05:57:47 -08:00

gpu_ubatch_wrapper.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

gpu_worker.py

Update batch invariant to use attention config (#30704)

2025-12-15 15:24:16 -05:00

kv_connector_model_runner_mixin.py

[KVConnector] Add KV events to KV Connectors (#28309)

2025-12-11 15:30:29 +01:00

lora_model_runner_mixin.py

[LoRA] Cleanup LoRA unused code (#29611)

2025-11-28 22:52:58 -08:00

tpu_input_batch.py

[BugFix] Fix chunked prompt logprobs + preemption (#29071)

2025-11-22 16:07:18 -05:00

tpu_model_runner.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

tpu_worker.py

[Bugfix] tpu_model_runner: set vllm config context when calling reset_dynamo_cache() (#30331)

2025-12-10 04:58:35 -08:00

ubatch_utils.py

[BugFix] Fix DBO assert assert B_block_table == B_q (#29933)

2025-12-04 14:48:54 -05:00

ubatching.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

utils.py

[CPU] Support for Whisper (#30062)

2025-12-10 04:58:42 -08:00

worker_base.py

[CI] Fix mypy for vllm/v1/worker (#29037)

2025-11-21 11:36:07 +08:00

workspace.py

[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532)

2025-12-12 05:57:47 -08:00

xpu_model_runner.py

Replace torch.cuda.Event with torch.Event for better hardware compatibility (#26985)

2025-11-18 11:34:36 -08:00

xpu_worker.py

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00