biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Adding cpu inference with VXE ISA for s390x architecture (#12613)

Browse Source 
Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
Signed-off-by: Rishika Kedia <rishika.kedia@in.ibm.com>
Co-authored-by: Rishika Kedia <rishika.kedia@in.ibm.com>
This commit is contained in:
Dilip Gowda Bhagavan
2025-03-06 22:10:53 +05:30
committed by GitHub
parent bf0560bda9
commit ada19210a3
7 changed files with 653 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
csrc/cpu/quant.cpp
View File

@@ -25,7 +25,7 @@ struct KernelVecType<c10::BFloat16> {
template <>
struct KernelVecType<c10::Half> {
#ifdef __powerpc64__
#if defined(__powerpc64__) || defined(__s390x__)
// Power architecture-specific vector type
using load_vec_type = vec_op::FP32Vec16;
#else