Dan Lord 20f7cc4cde Add skip_special_tokens sampling params (#1186)

2023-09-27 19:21:42 -07:00

..

openai

Add skip_special_tokens sampling params (#1186)

2023-09-27 19:21:42 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

api_server.py

clean api code, remove redundant background task. (#1102)

2023-09-21 13:25:05 -07:00

llm.py

Add gpu_memory_utilization and swap_space to LLM (#1090)

2023-09-19 22:16:04 -07:00