This website requires JavaScript.
Explore
Help
Register
Sign In
biondizzle
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
29bc01bf3bc26642e4cee15ebd36a6ce5799326d
vllm
/
csrc
/
attention
History
Cody Yu
c833101740
[Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (
#4535
)
2024-05-09 18:04:17 -06:00
..
attention_dtypes.h
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
attention_generic.cuh
Change the name to vLLM (
#150
)
2023-06-17 03:07:40 -07:00
attention_kernels.cu
[Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (
#4535
)
2024-05-09 18:04:17 -06:00
attention_utils.cuh
Merge EmbeddedLLM/vllm-rocm into vLLM main (
#1836
)
2023-12-07 23:16:52 -08:00
dtype_bfloat16.cuh
Merge EmbeddedLLM/vllm-rocm into vLLM main (
#1836
)
2023-12-07 23:16:52 -08:00
dtype_float16.cuh
Merge EmbeddedLLM/vllm-rocm into vLLM main (
#1836
)
2023-12-07 23:16:52 -08:00
dtype_float32.cuh
[BugFix] Fix NaN errors in paged attention kernel (
#936
)
2023-09-04 09:20:06 +09:00
dtype_fp8.cuh
[Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (
#4535
)
2024-05-09 18:04:17 -06:00
