elvischenv 5d6ce2b960 [Perf] Support stream interval for reducing host overhead (#27869) ...

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

2025-11-13 13:21:25 -05:00

..

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

conftest.py

[Misc] Remove isort and yapf ignores (#26888)

2025-10-15 12:09:03 +00:00

test_async_llm.py

[V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955)

2025-11-04 20:51:16 -08:00

test_engine_args.py

[CI/Build] Fix test_defaults_with_usage_context in AMD CI (#27926)

2025-11-05 15:40:24 -08:00

test_engine_core_client.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

test_engine_core.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

test_fast_incdec_prefix_err.py

Remove all cases of fmt: on/off (#26253)

2025-10-05 09:18:14 -07:00

test_llm_engine.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

test_output_processor.py

[Perf] Support stream interval for reducing host overhead (#27869)

2025-11-13 13:21:25 -05:00

test_parallel_sampling.py

[n-gen] DO NOT repeatedly return finished child requests (#28591)

2025-11-13 03:36:07 +00:00

test_processor_multi_modal_uuids.py

[Bugfix] Fix SHM cache initialization (#26427)

2025-10-09 02:48:04 -07:00

utils.py

[Perf] Use np.ndarray instead of list[list[int]] to reduce GC overhead (#28245)

2025-11-11 10:28:47 -08:00