This website requires JavaScript.
Explore
Help
Register
Sign In
biondizzle
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
805de738f618f8b47ab0d450423d23db1e636fa2
vllm
/
csrc
/
attention
History
Dean Leitersdorf
79af7e96a0
[OPTIMIZATION] Optimizes the single_query_cached_kv_attention kernel (
#420
)
2023-08-04 10:57:29 -07:00
..
attention_dtypes.h
Improve setup script & Add a guard for bfloat16 kernels (
#130
)
2023-05-27 00:59:32 -07:00
attention_generic.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
attention_kernels.cu
[OPTIMIZATION] Optimizes the single_query_cached_kv_attention kernel (
#420
)
2023-08-04 10:57:29 -07:00
attention_utils.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
dtype_bfloat16.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
dtype_float16.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
dtype_float32.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
