Ning Xie 3f3313981c [kv cache] update num_free_blocks in the end (#24228) ...

Signed-off-by: Andy Xie <andy.xning@gmail.com>

2025-09-15 05:15:12 +00:00

..

attention

Add FLASHINFER_MLA to backend selector test (#24753)

2025-09-12 22:30:07 +00:00

core

[kv cache] update num_free_blocks in the end (#24228)

2025-09-15 05:15:12 +00:00

cudagraph

[Attention] FlashAttention MLA cudagraph support (#23958)

2025-09-08 22:05:26 +00:00

e2e

[CI][Spec Decode] Adjust threshold for flaky ngram spec decoding test again (#24771)

2025-09-13 15:45:11 +08:00

engine

[Core] Support async scheduling with uniproc executor (#24219)

2025-09-12 16:34:28 -07:00

entrypoints

Extend renderer with embedding support and integrate completion endpoint (#24405)

2025-09-10 01:46:46 +08:00

executor

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

kv_connector

[Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673)

2025-09-08 21:34:37 -07:00

logits_processors

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

metrics

[Misc] Have AsyncLLM custom_stat_loggers extend default logger list (#20952)

2025-09-04 14:25:30 -07:00

sample

[Sampler] Support returning all prompt logprobs (#23868)

2025-09-07 19:34:31 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

Move LoadConfig from config/__init__.py to config/load.py (#24566)

2025-09-10 06:14:18 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[Hybrid Allocator] Support Pipeline Parallel (#23974)

2025-09-14 15:55:17 -07:00

tracing

[V1] feat:add engine v1 tracing (#20372)

2025-09-11 17:10:39 -07:00

worker

[Hybrid Allocator] Support Pipeline Parallel (#23974)

2025-09-14 15:55:17 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[BugFix] Async scheduling and PP compatibility with DP (#23770)

2025-08-29 08:17:27 -07:00

test_external_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_hybrid_lb_dp.py

[Tests] Harden DP tests (#21508)

2025-07-25 02:27:24 -07:00

test_internal_lb_dp.py

[BugFix] Fix port lookup in internal DP LB tests (#22252)

2025-08-15 11:17:11 +08:00

test_kv_sharing.py

[Doc]: fix typos in Python comments (#24077)

2025-09-02 02:38:55 -07:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[v1] Add Whisper model support (encoder-decoder) (#21088)

2025-09-10 13:53:35 -07:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053)

2025-08-18 09:52:00 +00:00

test_utils.py

Support encoder-only models without KV-Cache (#21270)

2025-07-26 21:09:52 +08:00