biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Clean up remaining Punica C information (#7027)

Browse Source
This commit is contained in:
Jee Jee Li
2024-08-05 06:37:08 +08:00
committed by GitHub
parent 16a1cc9bb2
commit f80ab3521c
5 changed files with 3 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
cmake/utils.cmake
View File

@@ -181,7 +181,7 @@ macro(override_gpu_arches GPU_ARCHES GPU_LANG GPU_SUPPORTED_ARCHES)
#
# The torch cmake setup hardcodes the detected architecture flags in
# `CMAKE_CUDA_FLAGS`. Since `CMAKE_CUDA_FLAGS` is a "global" variable, it
# can't modified on a per-target basis, e.g. for the `punica` extension.
# can't modified on a per-target basis.
# So, all the `-gencode` flags need to be extracted and removed from
# `CMAKE_CUDA_FLAGS` for processing so they can be passed by another method.
# Since it's not possible to use `target_compiler_options` for adding target