Woosuk Kwon 6afc0ffaf6 [Model Runner V2] Add sample/ directory and reorganize files (#29719) ...

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2025-11-29 00:41:01 -08:00

..

attention

[BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698)

2025-11-28 20:19:01 -08:00

core

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

engine

[Chore] Rename Processor to InputProcessor (#29682)

2025-11-28 09:35:41 -08:00

executor

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

kv_offload

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

metrics

[mypy] Enable type checking for more directories (#29674)

2025-11-28 08:39:27 -08:00

pool

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

sample

[mypy] Enable type checking for more directories (#29674)

2025-11-28 08:39:27 -08:00

spec_decode

[Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597)

2025-11-28 22:25:05 +00:00

structured_output

[Bugfix] Fix llguidance backend, rollback when EOS was encountered (#25905)

2025-11-10 14:53:32 -05:00

worker

[Model Runner V2] Add sample/ directory and reorganize files (#29719)

2025-11-29 00:41:01 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579)

2025-11-26 14:07:13 -05:00

kv_cache_interface.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

request.py

[KV Connector] Fix async connector prefix cache metrics (#28585)

2025-11-21 17:45:00 -05:00

serial_utils.py

[DisaggEverything] Tokens in<>out /generate endpoint (#24261)

2025-11-14 09:58:01 -07:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00