Yong Hoon Shin 8564dc9448 Fix test_kv_sharing_fast_prefill flakiness (#22038) ...

Signed-off-by: Yong Hoon Shin <yhshin@meta.com>

2025-08-01 23:55:34 -07:00

..

attention

[Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153)

2025-08-01 19:47:53 -07:00

core

[Misc] Improve code readability of KVCacheManager (#21673)

2025-07-30 07:20:43 -07:00

e2e

Fix test_kv_sharing_fast_prefill flakiness (#22038)

2025-08-01 23:55:34 -07:00

engine

[Bugfix] fix when skip tokenizer init (#21922)

2025-08-01 10:09:36 -07:00

entrypoints

[Tests] Add tests for headless internal DP LB (#21450)

2025-07-23 07:49:25 -07:00

kv_connector

[CI Bugfix] Fix CI OOM for test_shared_storage_connector_hashes (#21973)

2025-07-31 11:45:29 +08:00

metrics

Enable v1 metrics tests (#20953)

2025-07-20 03:22:02 +00:00

sample

[Sampler] Introduce logprobs mode for logging (#21398)

2025-07-23 01:39:25 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[v1][attention] Support Hybrid Allocator + FlashInfer (#21412)

2025-07-30 01:45:29 +00:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[Deprecation][2/N] Replace --task with --runner and --convert (#21470)

2025-07-27 19:42:40 -07:00

worker

[v1][attention] Support Hybrid Allocator + FlashInfer (#21412)

2025-07-30 01:45:29 +00:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

Deprecate --disable-log-requests and replace with --enable-log-requests (#21739)

2025-08-01 17:16:37 +01:00

test_external_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_hybrid_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_internal_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[V0 deprecation] Guided decoding (#21347)

2025-07-29 03:15:30 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00