Sanket Kale a6760f6456 [Feature] vLLM ARM Enablement for AARCH64 CPUs (#9228) ...

Signed-off-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: Sanket Kale <sanketk.kale@fujitsu.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

2024-11-25 18:32:39 -08:00

..

attention

…

core

…

cpu

…

cutlass_extensions

…

mamba

…

moe

…

prepare_inputs

…

quantization

…

rocm

…

activation_kernels.cu

…

cache_kernels.cu

…

cache.h

…

cuda_compat.h

…

cuda_utils_kernels.cu

…

cuda_utils.h

…

custom_all_reduce_test.cu

…

custom_all_reduce.cu

…

custom_all_reduce.cuh

…

dispatch_utils.h

…

layernorm_kernels.cu

…

layernorm_quant_kernels.cu

…

ops.h

…

permute_cols.cu

…

pos_encoding_kernels.cu

…

torch_bindings.cpp

…

type_convert.cuh

…