Wentao Ye ed2f282bc8 [Perf] Optimize redundant sync for pooling model, 3.7% Throughput Improvement (#39113) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2026-04-08 23:12:23 -07:00

..

gpu

[Model Runner V2] Fuse probabilistic rejection sample kernels (#38496)

2026-04-07 17:37:37 -07:00

__init__.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

block_table.py

Fix Mamba state corruption from referencing stale block table entries (#37728) (#37728) (#37728)

2026-03-24 10:29:59 -07:00

cp_utils.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

cpu_model_runner.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

cpu_worker.py

[CPU] Replace OMP initialization (#36487)

2026-04-03 18:42:43 +08:00

dp_utils.py

[Log] Reduce duplicate log (#37313)

2026-03-18 10:57:44 -04:00

ec_connector_model_runner_mixin.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

encoder_cudagraph_defs.py

Relocate Encoder CUDA graph manager (#38116)

2026-03-25 20:52:12 -07:00

encoder_cudagraph.py

[Bug] Fix Import paths for encoder_cudagraph modules (#38997)

2026-04-05 19:11:58 +00:00

gpu_input_batch.py

Generative Scoring (#34539)

2026-03-31 16:02:11 -07:00

gpu_model_runner.py

[Perf] Optimize redundant sync for pooling model, 3.7% Throughput Improvement (#39113)

2026-04-08 23:12:23 -07:00

gpu_ubatch_wrapper.py

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980)

2026-04-08 18:56:32 -07:00

gpu_worker.py

[1/N][Cleanup] Standardize on use of is_quantized_kv_cache (#38659)

2026-04-01 04:08:01 +00:00

kv_connector_model_runner_mixin.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

lora_model_runner_mixin.py

Reduce the kernel overhead when num of active loras is smaller than max loras. Multiple cuda graphs are captured for each num of active-loras. (#32005)

2026-02-02 12:30:06 -05:00

mamba_utils.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

tpu_input_batch.py

[Cleanup] Remove unused ModelRunner V1 InputBatch.num_tokens field (#30218)

2025-12-18 09:17:00 -08:00

ubatch_utils.py

[6/N][Attention] Move utils to more appropriate locations (#32215)

2026-01-13 05:38:52 -08:00

ubatching.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

worker_base.py

[Feat][Executor] Introduce RayExecutorV2 (#36836)

2026-04-01 14:34:29 -07:00

workspace.py

[Bug] Fix workspace manager _current_workspaces size (#38853)

2026-04-04 01:29:45 +00:00

xpu_model_runner.py

[Refactor] Remove dead code in kv connector and model runner (#38383)

2026-03-31 17:05:23 -04:00

xpu_worker.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00