This website requires JavaScript.
Explore
Help
Register
Sign In
biondizzle
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
33e0823de583819f39e88c39ea3f7dd4e07c3990
vllm
/
csrc
/
quantization
/
gptq_marlin
History
Jinzhen Lin
99caa49106
[Kernel] add bfloat16 support for gptq marlin kernel (
#4788
)
2024-05-16 09:55:29 -04:00
..
gptq_marlin_dtypes.cuh
[Kernel] add bfloat16 support for gptq marlin kernel (
#4788
)
2024-05-16 09:55:29 -04:00
gptq_marlin_repack.cu
[Kernel] Support running GPTQ 8-bit models in Marlin (
#4533
)
2024-05-02 12:56:22 -04:00
gptq_marlin.cu
[Kernel] add bfloat16 support for gptq marlin kernel (
#4788
)
2024-05-16 09:55:29 -04:00
gptq_marlin.cuh
[Kernel] Support running GPTQ 8-bit models in Marlin (
#4533
)
2024-05-02 12:56:22 -04:00
