Hyeonki Hong 25f2b55319 [Frontend] feat: add streaming support for token generation endpoint (#37171) ...

Signed-off-by: Hyeonki Hong <hyeonki.hong@moreh.io>

2026-04-03 10:20:32 +00:00

..

anthropic

[Refactor] Relocate endpoint tests to mirror serving code directory structure (#37504)

2026-03-19 07:19:36 +00:00

llm

[Refactor] Relocate tests from tests/v1/entrypoints/ to tests/entrypoints/ (#37500)

2026-03-20 02:50:34 -07:00

offline_mode

Various Transformers v5 fixes (#38127)

2026-03-26 00:10:08 +00:00

openai

Generative Scoring (#34539)

2026-03-31 16:02:11 -07:00

pooling

[Frontend] Re-enable running MaxSim on GPU (#38620)

2026-04-03 00:03:13 +08:00

rpc

[Refactor] [4/N] Move VLLM_SERVER_DEV endpoints into the serve directory (#30749)

2025-12-17 02:27:30 -08:00

sagemaker

[openapi server] log exception in exception handler(2/N) (#36201)

2026-03-10 20:16:30 -07:00

serve

[Frontend] feat: add streaming support for token generation endpoint (#37171)

2026-04-03 10:20:32 +00:00

weight_transfer

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

conftest.py

[Feat] allow inplace loading lora (#31326)

2026-01-20 10:15:20 +08:00

test_api_server_process_manager.py

[Frontend] Move APIServerProcessManager target server fn (#38115)

2026-03-25 18:14:41 +00:00

test_chat_utils.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00

test_context.py

[Bugfix] Fix Harmony preamble visibility in Responses API (#32114)

2026-02-25 08:08:16 -08:00

test_launch_cli.py

[Frontend] Add vllm launch command for GPU-less preprocessing serving (#34551)

2026-03-04 18:41:52 +00:00

test_ssl_cert_refresher.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

test_utils.py

[Bugfix] Force continuous usage stats when CLI override is enabled (#37923)

2026-03-24 10:29:50 -07:00