Kunshang Ji 96b6f475dd Remove hardcoded device="cuda" to support more devices (#2503) ...

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

2024-02-01 15:46:39 -08:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

Remove hardcoded device="cuda" to support more devices (#2503)

2024-02-01 15:46:39 -08:00

async_llm_engine.py

fix some bugs (#2689)

2024-01-31 10:09:23 -08:00

llm_engine.py

Remove hardcoded device="cuda" to support more devices (#2503)

2024-02-01 15:46:39 -08:00

metrics.py

Refactor Prometheus and Add Request Level Metrics (#2316)

2024-01-31 14:58:07 -08:00

ray_utils.py

[Minor] Fix warning on Ray dependencies (#2630)

2024-01-27 15:43:40 -08:00