tvirolai-amd a9e532afe2 [ROCm][Perf] Allow MTP lens > 1 in Sparse MLA (#36681) ...

Signed-off-by: Teemu Virolainen <teemu.virolainen@amd.com>

2026-03-11 14:43:03 +00:00

..

attention

Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230)

2026-03-11 19:19:15 +08:00

core

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

engine

[Bugfix] Surface exceptions from non-blocking execute_model in UniProcExecutor to avoid DP deadlocks (#35194)

2026-03-11 03:22:21 +00:00

executor

[Bugfix] Surface exceptions from non-blocking execute_model in UniProcExecutor to avoid DP deadlocks (#35194)

2026-03-11 03:22:21 +00:00

kv_offload

feat(kv-offload): Strategy A — StoreReusedOffloadingManager gates CPU stores on reuse frequency (#35342)

2026-03-10 14:43:40 +00:00

metrics

[Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950)

2026-02-23 15:01:07 +00:00

pool

[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E throughput improvement (#36159)

2026-03-09 20:55:58 -07:00

sample

[CI] Bump mypy version (#34950)

2026-03-04 20:55:11 +00:00

spec_decode

[ROCm][Perf] Allow MTP lens > 1 in Sparse MLA (#36681)

2026-03-11 14:43:03 +00:00

structured_output

[Perf] Optimize Python Slice for Structured Output using islice instead of [:] (#33593)

2026-02-24 09:02:36 -08:00

worker

[XPU]Bug fix for some unexpected error when use AgRs backend on XPU device. (#36593)

2026-03-11 09:17:46 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[UX][Startup] Account for CUDA graphs during memory profiling (#30515)

2026-03-07 13:49:23 -08:00

kv_cache_interface.py

[BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219)

2026-03-10 03:32:20 -07:00

outputs.py

[Spec Decode] Add hidden states extraction system (#33736)

2026-03-02 14:29:09 -05:00

request.py

[Deprecation][1/2] Remove items deprecated in v0.18 (#36470)

2026-03-09 03:43:23 -07:00

serial_utils.py

[Multimodal] Simplify MM input definitions (#33331)

2026-01-29 13:32:04 +00:00

utils.py

[Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628)

2026-03-10 06:20:41 -07:00