Huamin Li 1fe462168c [perf] Avoid dtype promotion sync in mamba_get_block_table_tensor (#34870) ...

Signed-off-by: Huamin Li <3ericli@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

2026-02-20 06:21:56 -08:00

..

attention

[perf] Avoid dtype promotion sync in mamba_get_block_table_tensor (#34870)

2026-02-20 06:21:56 -08:00

core

[Scheduler][ASR] Fix CrossAttn blocks per-request for Variable length encoder inputs (#31058)

2026-02-16 11:08:44 +00:00

engine

[Refactor] Implement output type check in LLM (#34794)

2026-02-19 19:57:55 -08:00

executor

[Bugfix] Fix Basic Models Test (#34818)

2026-02-19 14:49:07 -08:00

kv_offload

[Bugfix] Fix ARC touch KeyError for non-ready T1 blocks in kv offload (#34576)

2026-02-16 07:33:19 -08:00

metrics

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510)

2026-02-14 10:14:21 -08:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[Kernel] Triton-based Top-k and Top-p sampler kernels (#33538)

2026-02-17 23:14:30 +00:00

spec_decode

[Bugfix] Fix MTP accuracy for GLM-5 (#34385)

2026-02-12 11:08:19 +08:00

structured_output

[Refactor] Simplify BOS/EOS token handling (#34435)

2026-02-12 18:18:24 -08:00

worker

[BUGFIX] Fix _dummy_run missing prepare_inputs_event synchronization (#34866)

2026-02-20 05:54:27 -08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[CI] Enable mypy coverage for individual excluded files (#34292)

2026-02-16 07:34:29 -08:00

kv_cache_interface.py

Make mypy opt-out instead of opt-in (#33205)

2026-01-29 09:12:26 +00:00

outputs.py

[ModelRunner V2] Fix spec decoding + logprobs (#33391)

2026-01-31 03:33:26 +00:00

request.py

[Refactor] Simplify BOS/EOS token handling (#34435)

2026-02-12 18:18:24 -08:00

serial_utils.py

[Multimodal] Simplify MM input definitions (#33331)

2026-01-29 13:32:04 +00:00

utils.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00