shiyi.c_98 d10f8e1d43 [Experimental] Prefix Caching Support (#1669) ...

Co-authored-by: DouHappy <2278958187@qq.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2024-01-17 16:32:10 -08:00

..

api_client.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

gradio_openai_chatbot_webserver.py

Add gradio chatbot for openai webserver (#2307)

2024-01-11 19:45:56 -08:00

gradio_webserver.py

Remove deprecated parameter: concurrency_count (#2315)

2024-01-03 09:56:21 -08:00

llm_engine_example.py

Refactor LLMEngine demo script for clarity and modularity (#1413)

2023-10-30 09:14:37 -07:00

offline_inference_with_prefix.py

[Experimental] Prefix Caching Support (#1669)

2024-01-17 16:32:10 -08:00

offline_inference.py

[Quality] Add code formatter and linter (#326)

2023-07-03 11:31:55 -07:00

openai_chatcompletion_client.py

chore(examples-docs): upgrade to OpenAI V1 (#1785)

2023-12-03 01:11:22 -08:00

openai_completion_client.py

chore(examples-docs): upgrade to OpenAI V1 (#1785)

2023-12-03 01:11:22 -08:00

template_alpaca.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00

template_baichuan.jinja

Add baichuan chat template jinjia file (#2390)

2024-01-09 09:13:02 -08:00

template_chatml.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00

template_inkbot.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00