154 Commits

Author	SHA1	Message	Date
Massimiliano Pronesti	93dc5a2870	chore(vllm): codespell for spell checking (#2820)	2024-02-21 18:56:01 -08:00
Terry	2a543d6efe	Add LoRA support for Mixtral (#2831) ... * add mixtral lora support * formatting * fix incorrectly ported logic * polish tests * minor fixes and refactoring * minor fixes * formatting * rename and remove redundant logic * refactoring * refactoring * minor fix * minor refactoring * fix code smell	2024-02-14 00:55:45 +01:00
Kunshang Ji	96b6f475dd	Remove hardcoded device="cuda" to support more devices (#2503) ... Co-authored-by: Jiang Li <jiang1.li@intel.com> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>	2024-02-01 15:46:39 -08:00
Antoni Baum	9b945daaf1	[Experimental] Add multi-LoRA support (#1804) ... Co-authored-by: Chen Shen <scv119@gmail.com> Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by: Avnish Narayan <avnish@anyscale.com>	2024-01-23 15:26:37 -08:00