Antoni Baum c9927c1a6a Use queue for finished requests (#957)

2023-09-05 19:27:23 -07:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[Fix] Add model sequence length into model config (#575)

2023-07-25 23:46:30 -07:00

async_llm_engine.py

Use queue for finished requests (#957)

2023-09-05 19:27:23 -07:00

llm_engine.py

Align vLLM's beam search implementation with HF generate (#857)

2023-09-04 17:29:42 -07:00

ray_utils.py

[Fix] fix import error of RayWorker (#604) (#605)

2023-07-27 23:37:40 -07:00