requirements.txt

ninja  # For faster builds.
psutil
ray >= 2.5.1
sentencepiece  # Required for LLaMA tokenizer.
numpy
torch == 2.1.2
transformers >= 4.36.0  # Required for Mixtral.
xformers == 0.0.23.post1  # Required for CUDA 12.1.
fastapi
uvicorn[standard]
pydantic >= 2.0  # Required for OpenAI server.
aioprometheus[starlette]
Specify python package dependencies in requirements.txt (#78) 2023-05-07 16:30:43 -07:00			`ninja # For faster builds.`
			`psutil`
Ray placement group support (#397) 2023-07-19 22:49:31 -07:00			`ray >= 2.5.1`
Specify python package dependencies in requirements.txt (#78) 2023-05-07 16:30:43 -07:00			`sentencepiece # Required for LLaMA tokenizer.`
			`numpy`
Pin PyTorch & xformers versions (#2155) 2023-12-17 01:46:54 -08:00			`torch == 2.1.2`
Upgrade transformers version to 4.36.0 (#2046) 2023-12-11 18:39:14 -08:00			`transformers >= 4.36.0 # Required for Mixtral.`
[Minor] Fix xformers version (#2158) 2023-12-17 02:28:02 -08:00			`xformers == 0.0.23.post1 # Required for CUDA 12.1.`
Specify python package dependencies in requirements.txt (#78) 2023-05-07 16:30:43 -07:00			`fastapi`
Use standard extras for uvicorn (#1166) 2023-09-27 21:41:36 -03:00			`uvicorn[standard]`
migrate pydantic from v1 to v2 (#2531) 2024-01-22 01:05:56 +01:00			`pydantic >= 2.0 # Required for OpenAI server.`
Add Production Metrics in Prometheus format (#1890) 2023-12-02 16:37:44 -08:00			`aioprometheus[starlette]`