Lumosis 66652e8082 [BugFix] Assign page_size_padded when unifying kv cache spec. (#32283) ...

Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>

2026-01-14 20:10:01 +00:00

..

attention

[Bugfix][ROCm][performance] Resolve the performance regression issue of the Qwen3-Next-80B-A3B-Thinking under rocm_atten (#32336)

2026-01-14 19:32:48 +00:00

core

[BugFix] Assign page_size_padded when unifying kv cache spec. (#32283)

2026-01-14 20:10:01 +00:00

engine

[1/N] Reorganize multimodal processing code (#32327)

2026-01-14 15:25:31 +00:00

executor

[Chore] Try remove init_cached_hf_modules (#31786)

2026-01-07 12:34:04 +08:00

kv_offload

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

2026-01-12 15:00:43 +00:00

metrics

[Metrics] Model FLOPs Utilization estimation (#30738)

2025-12-18 01:40:51 +00:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[perf][async] support non cpu sync get logprob tensors for spec (#31336)

2026-01-09 21:24:51 +00:00

spec_decode

[4/N][Attention] Move MLA common to model_executor (#32060)

2026-01-13 09:08:45 -08:00

structured_output

[Misc] Various code simplifications (#31666)

2026-01-04 18:35:56 -08:00

worker

[Misc] Make mem utils can be reused by other platforms (#32322)

2026-01-14 03:46:01 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[BugFix] Fix assert batch_descriptor.num_tokens == num_tokens_padded (#30173)

2025-12-09 10:36:12 -05:00

kv_cache_interface.py

Decouple page_size_bytes calculation in AttentionSpec for TPU/RPA Compatibility. (#31635)

2026-01-08 09:00:07 +00:00

outputs.py

[perf][async] support non cpu sync get logprob tensors for spec (#31336)

2026-01-09 21:24:51 +00:00

request.py

[BugFix] scheduler: Fix resuming of preempted requests after async load (#31583)

2026-01-10 12:39:25 -08:00

serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

[Feature] Add iteration level logging and enhance nvtx marker (#31193)

2026-01-09 00:13:39 +00:00