Laith Sakka 2e0ad629b0 Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110) ...

Signed-off-by: Laith Sakka <lsakka@meta.com>

2025-11-14 14:11:10 -08:00

..

attention

[BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702)

2025-11-14 12:19:22 +00:00

core

[Chore] Rename SchedulerConfig.chunked_prefill_enabled (#28735)

2025-11-14 18:39:57 +00:00

engine

[Chore] Rename SchedulerConfig.chunked_prefill_enabled (#28735)

2025-11-14 18:39:57 +00:00

executor

[DCP] Support Decode Context Parallel (DCP) for GQA with Flashinfer (#25438)

2025-11-14 11:24:10 +00:00

kv_offload

Implement ARC KV cache eviction policy for CPU offloader (#27039)

2025-11-12 09:51:39 -08:00

metrics

[Metrics] Log number of preempted requests (#28522)

2025-11-14 09:47:45 +00:00

pool

[Chore] Separate out vllm.utils.platform_utils.py (#27374)

2025-10-23 19:08:06 +00:00

sample

[Performance] Cache loaded custom logitsprocs to avoid overheads (#28462)

2025-11-11 16:49:29 -08:00

spec_decode

Rename clashing method names for vLLM model protocol (#27583)

2025-11-12 19:14:33 -08:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

worker

Avoid bytecode hook and simplify TorchCompileWrapperWithCustomDipatch (#25110)

2025-11-14 14:11:10 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[LoRA] LoRA cuda graph specialization (#25914)

2025-10-20 04:21:09 +00:00

kv_cache_interface.py

[Hybrid] Pass kernel block size to builders (#27753)

2025-11-03 05:48:03 +00:00

outputs.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

request.py

[Feature]: Add corrupted request metric to V1 metrics system. (#27306)

2025-11-05 13:45:29 -08:00

serial_utils.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

utils.py

[Misc] Clean up more utils (#27567)

2025-10-27 15:30:38 +00:00