Nick Hill 657f2f301a [DP] Support external DP Load Balancer mode (#19790) ...

Signed-off-by: Nick Hill <nhill@redhat.com>

2025-07-02 10:21:52 -07:00

..

core

[Optimization] Use Shared CachedRequestData Instance Across All Requests (#20232)

2025-06-30 09:07:50 -07:00

e2e

[CI] change spell checker from codespell to typos (#18711)

2025-06-11 19:57:10 -07:00

engine

[DP] Support external DP Load Balancer mode (#19790)

2025-07-02 10:21:52 -07:00

entrypoints

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

kv_connector

[Optimization] Use Shared CachedRequestData Instance Across All Requests (#20232)

2025-06-30 09:07:50 -07:00

metrics

Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113)

2025-06-04 17:10:45 +08:00

sample

[V1] LogitsProcessor programming model (#16728)

2025-07-02 09:10:42 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[UT][intel GPU] use current_platform instead of device hardcode in v1 tests (#20169)

2025-07-02 09:06:04 +08:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[TPU] kv cache update kernel supports dynamic grid (#20235)

2025-07-02 06:33:37 +00:00

worker

[V1] LogitsProcessor programming model (#16728)

2025-07-02 09:10:42 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[Core] Raise when non-multi-instance DP clients target a DP rank (#19227)

2025-06-06 19:03:01 +08:00

test_external_lb_dp.py

[DP] Support external DP Load Balancer mode (#19790)

2025-07-02 10:21:52 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[Fix][V1] Remove --scheduling-policy oracle (#20010)

2025-06-24 09:52:15 -07:00

test_request.py

[Misc] Add __str__ for RequestStatus (#19780)

2025-06-18 03:03:01 +00:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00