youkaichao 6dd94dbe94 [perf] fix perf regression from #12253 (#12380) ...

Signed-off-by: youkaichao <youkaichao@gmail.com>

2025-01-24 11:34:27 +08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

cache_engine.py

[Model] PP support for Mamba-like models (#10992)

2024-12-10 21:53:37 -05:00

cpu_enc_dec_model_runner.py

[torch.compile] Hide KV cache behind torch.compile boundary (#11677)

2025-01-10 13:14:42 +08:00

cpu_model_runner.py

[core] separate builder init and builder prepare for each batch (#12253)

2025-01-22 14:13:52 +08:00

cpu_pooling_model_runner.py

[torch.compile] Hide KV cache behind torch.compile boundary (#11677)

2025-01-10 13:14:42 +08:00

cpu_worker.py

[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100)

2025-01-12 13:01:52 +00:00

enc_dec_model_runner.py

[torch.compile] Hide KV cache behind torch.compile boundary (#11677)

2025-01-10 13:14:42 +08:00

hpu_model_runner.py

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

hpu_worker.py

[Bugfix] Fix HPU multiprocessing executor (#12167)

2025-01-23 02:07:07 +08:00

model_runner_base.py

[core] separate builder init and builder prepare for each batch (#12253)

2025-01-22 14:13:52 +08:00

model_runner.py

[perf] fix perf regression from #12253 (#12380)

2025-01-24 11:34:27 +08:00

multi_step_model_runner.py

[Misc] Add multipstep chunked-prefill support for FlashInfer (#10467)

2025-01-15 12:47:49 +08:00

multi_step_tpu_worker.py

[TPU] Implement multi-step scheduling (#8489)

2024-09-14 16:58:31 -07:00

multi_step_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

neuron_model_runner.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

neuron_worker.py

[core] platform agnostic executor via collective_rpc (#11256)

2025-01-15 13:45:21 +08:00

openvino_model_runner.py

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

openvino_worker.py

[Core] Interface for accessing model from VllmRunner (#10353)

2025-01-20 15:00:59 +08:00

pooling_model_runner.py

[torch.compile] Hide KV cache behind torch.compile boundary (#11677)

2025-01-10 13:14:42 +08:00

tpu_model_runner.py

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

tpu_worker.py

[Kernel] unified_attention for Attention.forward (#11967)

2025-01-13 19:28:53 +08:00

utils.py

[Doc][2/N] Reorganize Models and Usage sections (#11755)

2025-01-06 21:40:31 +08:00

worker_base.py

[core][bugfix] configure env var during import vllm (#12209)

2025-01-20 19:35:59 +08:00

worker.py

[torch.compile] decouple compile sizes and cudagraph sizes (#12243)

2025-01-24 02:01:30 +08:00

xpu_model_runner.py

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

xpu_worker.py

[XPU] Make pp group initilized for pipeline-parallelism (#11648)

2025-01-07 11:09:58 +08:00