biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix] Upgrade to pytorch 2.5.1 (#10001)

Browse Source 
Signed-off-by: Bill Nell <bill@neuralmagic.com>
This commit is contained in:
bnellnm
2024-11-04 18:11:28 -05:00
committed by GitHub
parent ac04a97a9f
commit d93478b399
7 changed files with 11 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
requirements-openvino.txt
View File

@@ -1,7 +1,7 @@
# Common dependencies
-r requirements-common.txt
torch == 2.5.0 # should be aligned with "common" vLLM torch version
torch == 2.5.1 # should be aligned with "common" vLLM torch version
openvino >= 2024.4.0 # since 2024.4.0 both CPU and GPU support Paged Attention
optimum @ git+https://github.com/huggingface/optimum.git@main # latest optimum is used to support latest transformers version