Hyunkyun Moon bc6be89d16 [Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551) ...

Signed-off-by: HyunKyun Moon <mhg5303@gmail.com>

2026-03-04 18:41:52 +00:00

..

attention

[Core] Add All-to-All communication backend for DCP (#34883)

2026-03-04 10:01:57 -05:00

core

[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783)

2026-03-04 15:01:30 +01:00

engine

[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551)

2026-03-04 18:41:52 +00:00

executor

[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783)

2026-03-04 15:01:30 +01:00

kv_offload

[Bugfix][CPUOffloadingManager] Prevent eviction of already-stored blocks in LRU/ARC prepare_store() (#35846)

2026-03-04 14:25:33 +02:00

metrics

[Metrics] Add Prometheus counters for Model FLOPs Utilization (MFU) (#30950)

2026-02-23 15:01:07 +00:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

spec_decode

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552)

2026-03-03 07:21:57 -08:00

structured_output

[Perf] Optimize Python Slice for Structured Output using islice instead of [:] (#33593)

2026-02-24 09:02:36 -08:00

worker

[BugFix] Fix implicit and incorrect assumption on ECConnector is_producer (#34783)

2026-03-04 15:01:30 +01:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Attention] FA4 integration (#32974)

2026-03-01 23:44:57 +00:00

kv_cache_interface.py

Make mypy opt-out instead of opt-in (#33205)

2026-01-29 09:12:26 +00:00

outputs.py

[Spec Decode] Add hidden states extraction system (#33736)

2026-03-02 14:29:09 -05:00

request.py

[Core] Add optional flags to check for repetitive token patterns in engine output (#35451)

2026-03-03 12:23:25 +08:00

serial_utils.py

[Multimodal] Simplify MM input definitions (#33331)

2026-01-29 13:32:04 +00:00

utils.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00