Matthew Bonanni f2c47886fd [Attention] Add FlashInfer Sparse MLA backend (#33451) ...

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

2026-02-12 17:21:54 +00:00

..

attention

[Attention] Add FlashInfer Sparse MLA backend (#33451)

2026-02-12 17:21:54 +00:00

core

[Core][BugFix] Fix PP KV cache sharding memory validation (#33698)

2026-02-10 10:46:24 -05:00

engine

[BUG] Reset running requests when clearing cache for pause/resume (#34382)

2026-02-12 16:19:13 +00:00

executor

[Feature] OTEL tracing during loading (#31162)

2026-02-05 16:59:28 -08:00

kv_offload

…

metrics

…

pool

…

sample

…

spec_decode

[Bugfix] Fix MTP accuracy for GLM-5 (#34385)

2026-02-12 11:08:19 +08:00

structured_output

[structured output] validate unsupported json features first (#33233)

2026-02-09 23:49:09 +00:00

worker

[Model Runner V2] Init cuda graph pool when necessary (#33217)

2026-02-11 09:12:13 -08:00

__init__.py

…

cudagraph_dispatcher.py

Reapply [Attention][FA3] Update FA3 to include new swizzle optimization (#34043)

2026-02-11 07:07:56 -08:00

kv_cache_interface.py

…

outputs.py

…

request.py

[Bugfix][Core] Fix CPU memory leak from Request reference cycle in prefix caching (#34183)

2026-02-10 13:03:32 +08:00

serial_utils.py

…

utils.py

…