Gregory Shtrasberg 9fa6c68fa6 [ROCm] Enabling encoder and encoder-decoder on ROCm and AITER unified backends (#35334) ...

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

2026-02-27 21:32:55 +00:00

..

attention

[ROCm] Enabling encoder and encoder-decoder on ROCm and AITER unified backends (#35334)

2026-02-27 21:32:55 +00:00

core

Remove bc-lint (#35274)

2026-02-26 03:01:01 -08:00

engine

[Refactor] Remove dead or duplicate func utils or variables (#35318)

2026-02-26 10:57:56 -05:00

executor

[Core]Extract is_last_rank in Ray for tpu to override (#33012)

2026-02-27 03:18:52 +00:00

kv_offload

[BugFix][kv_offload]: Fix kernel block size detection (#35125)

2026-02-26 16:29:34 +00:00

metrics

[Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950)

2026-02-23 15:01:07 +00:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[Core] Support min_tokens with speculative decoding (#32642)

2026-02-26 12:31:28 -05:00

spec_decode

[DP] Only use DP padding when cudagraphs are actually used (#34102)

2026-02-27 15:14:31 -05:00

structured_output

[Perf] Optimize Python Slice for Structured Output using islice instead of [:] (#33593)

2026-02-24 09:02:36 -08:00

worker

[DP] Only use DP padding when cudagraphs are actually used (#34102)

2026-02-27 15:14:31 -05:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[DP] Only use DP padding when cudagraphs are actually used (#34102)

2026-02-27 15:14:31 -05:00

kv_cache_interface.py

Make mypy opt-out instead of opt-in (#33205)

2026-01-29 09:12:26 +00:00

outputs.py

[ModelRunner V2] Fix spec decoding + logprobs (#33391)

2026-01-31 03:33:26 +00:00

request.py

[feat] Add per-block extra_keys to KV events (#33304)

2026-02-20 20:11:40 -08:00

serial_utils.py

[Multimodal] Simplify MM input definitions (#33331)

2026-01-29 13:32:04 +00:00

utils.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00