Ilya Markov 4e26d3b09e [Compile] Conditional compilation. Introduce compile_ranges (#24252) ...

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>

2025-12-05 18:17:32 +00:00

..

attention

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)

2025-12-05 09:48:43 -08:00

core

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)

2025-12-03 16:06:57 +00:00

engine

[BugFix] Eagerly abort cancelled final-step requests (#29987)

2025-12-05 17:28:32 +00:00

executor

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

kv_offload

[Attention] Update attention imports (#29540)

2025-11-27 11:19:09 -05:00

metrics

Add logging for cudagraph related info (#29825)

2025-12-03 01:01:48 -08:00

pool

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

sample

[Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826)

2025-12-02 21:25:52 +00:00

spec_decode

[BugFix] Fix DBO assert assert B_block_table == B_q (#29933)

2025-12-04 14:48:54 -05:00

structured_output

[BugFix] Adding env variable to disable async grammar compilation (#29996)

2025-12-05 00:49:37 -08:00

worker

[Compile] Conditional compilation. Introduce compile_ranges (#24252)

2025-12-05 18:17:32 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579)

2025-11-26 14:07:13 -05:00

kv_cache_interface.py

[Feature] Prefill Context Parallel (PCP) basic support (#28718)

2025-11-19 15:52:44 -05:00

outputs.py

[Model][6/N] Improve all pooling task | Support chunked prefill with ALL pooling (#27145)

2025-12-04 13:44:15 +00:00

request.py

[Bugfix] fix --scheduling-policy=priority & n>1 crashes engine (#29764)

2025-12-02 22:42:28 +00:00

serial_utils.py

[Chore] Deprecate merge_by_field_config arg (#30035)

2025-12-04 17:21:24 +00:00

utils.py

[BugFix] Fix async scheduling + chunked prefill + preemption (#28787)

2025-11-17 06:46:46 +08:00