Cyrus Leung 9edca6bf8f [Frontend] Online Pooling API (#11457) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-12-24 17:54:30 +08:00

..

tool_parsers

…

__init__.py

…

test_accuracy.py

…

test_async_tokenization.py

[Frontend] don't block event loop in tokenization (preprocess) in OpenAI compatible server (#10635)

2024-11-27 13:21:10 -08:00

test_audio.py

[CI] Fix flaky entrypoint tests (#11403)

2024-12-21 21:08:44 -08:00

test_basic.py

[Bugfix] Fix request cancellation without polling (#11190)

2024-12-17 12:26:32 -08:00

test_chat_echo.py

…

test_chat_template.py

…

test_chat.py

[CI] Expand OpenAI test_chat.py guided decoding tests (#11048)

2024-12-23 18:35:38 +00:00

test_chunked_prompt.py

…

test_cli_args.py

…

test_completion.py

…

test_embedding.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

test_encoder_decoder.py

…

test_lora_lineage.py

…

test_metrics.py

…

test_models.py

[Core] Support Lora lineage and base model metadata management (#6315)

2024-09-20 06:20:56 +00:00

test_oot_registration.py

[misc][plugin] add plugin system implementation (#7426)

2024-08-13 16:24:17 -07:00

test_pooling.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

test_prompt_validation.py

…

test_return_tokens_as_ids.py

[Tests] Disable retries and use context manager for openai client (#7565)

2024-08-26 21:33:17 -07:00

test_root_path.py

[Bug]: Authorization ignored when root_path is set (#10606)

2024-11-25 16:21:41 +00:00

test_run_batch.py

…

test_score.py

[Doc] Reorganize online pooling APIs (#11172)

2024-12-14 00:22:22 +08:00

test_serving_chat.py

[Feature] Add load generation config from model (#11164)

2024-12-19 10:50:38 +00:00

test_serving_engine.py

[Misc][LoRA] Ensure Lora Adapter requests return adapter name (#11094)

2024-12-12 09:25:16 +00:00

test_shutdown.py

…

test_tokenization.py

…

test_video.py

[CI] Fix flaky entrypoint tests (#11403)

2024-12-21 21:08:44 -08:00

test_vision_embedding.py

[Frontend] Online Pooling API (#11457)

2024-12-24 17:54:30 +08:00

test_vision.py

[CI] Fix flaky entrypoint tests (#11403)

2024-12-21 21:08:44 -08:00