Gregory Shtrasberg 22ad649501 [ROCm] Enabling forward_includes_kv_cache on ROCm MHA backends (#33106) ...

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

2026-01-28 14:36:14 +08:00

..

attention

[ROCm] Enabling forward_includes_kv_cache on ROCm MHA backends (#33106)

2026-01-28 14:36:14 +08:00

core

Add flake8-implicit-str-concat rules to Ruff (#33191)

2026-01-28 04:56:10 +00:00

engine

Add flake8-implicit-str-concat rules to Ruff (#33191)

2026-01-28 04:56:10 +00:00

executor

[Core][Bugfix] allow graceful worker termination (#32965)

2026-01-23 17:28:45 -08:00

kv_offload

[Metrics] [KVConnector] Add Offloading Connector metrics (#27942)

2026-01-27 13:34:49 +00:00

metrics

[Metrics][MFU] Fix UnembedMetrics FLOP overcounting for prefill (#33045) (#33045)

2026-01-27 15:16:49 +00:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[Refactor] Remove unused tpu files (#32610)

2026-01-22 15:35:18 -05:00

spec_decode

feature: support eagle3 for HunyuanVL & Hunyuan (#33035)

2026-01-27 17:55:48 +00:00

structured_output

[code clean] remove duplicate code (#33135)

2026-01-27 04:57:16 +00:00

worker

[Bugfix] Lazy import NgramProposer in GPU model runner (#32821)

2026-01-27 21:07:16 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[cudagraphs] Refactor cudagraph capture loop (#32946)

2026-01-23 13:22:20 -07:00

kv_cache_interface.py

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877)

2026-01-23 09:56:48 -08:00

outputs.py

[perf][async] support non cpu sync get logprob tensors for spec (#31336)

2026-01-09 21:24:51 +00:00

request.py

[Feature] add session based streaming input support to v1 (#28973)

2026-01-24 12:06:28 -08:00

serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

[Feature] Add iteration level logging and enhance nvtx marker (#31193)

2026-01-09 00:13:39 +00:00