Aaron Hao c1858b7ec8 [Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) ...

Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

2026-02-05 12:13:23 -05:00

..

attention

Revert "[Attention][FA3] Update FA3 to include new swizzle optimization" (#33841)

2026-02-04 19:54:27 -08:00

core

[KV Connector][Metrics] Do not count local prefix cache hits in connector queries (#30522)

2026-02-05 09:57:27 +02:00

engine

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

2026-02-05 12:13:23 -05:00

executor

[rocm][ray] Fix: Unify Ray device visibility handling across CUDA and ROCm (#33308)

2026-02-04 10:09:14 -08:00

kv_offload

[Metrics] [KVConnector] Add Offloading Connector metrics (#27942)

2026-01-27 13:34:49 +00:00

metrics

[Metrics] Add labeled prompt token metrics for P/D disaggregation (#33290)

2026-02-04 07:46:48 +00:00

pool

[Refactor] Clean up pooler modules (#31897)

2026-01-08 00:07:43 +08:00

sample

[perf] v1/spec_decode: skip softmax for all-greedy rejection sampling (#32852)

2026-01-31 09:51:26 +00:00

spec_decode

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

structured_output

[Perf] Optimize the performance of structured output + reasoning (#33557)

2026-02-05 15:45:29 +08:00

worker

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

2026-02-05 12:13:23 -05:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

Reduce the kernel overhead when num of active loras is smaller than max loras. Multiple cuda graphs are captured for each num of active-loras. (#32005)

2026-02-02 12:30:06 -05:00

kv_cache_interface.py

Make mypy opt-out instead of opt-in (#33205)

2026-01-29 09:12:26 +00:00

outputs.py

[ModelRunner V2] Fix spec decoding + logprobs (#33391)

2026-01-31 03:33:26 +00:00

request.py

[Perf] Optimize the performance of structured output + reasoning (#33557)

2026-02-05 15:45:29 +08:00

serial_utils.py

[Multimodal] Simplify MM input definitions (#33331)

2026-01-29 13:32:04 +00:00

utils.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00