biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
5,273 Commits 2 Branches 140 Tags
4cb1c05c9ee2d7e83b6984f70c19da7fe765f83c
Commit Graph

1 Commits

Author SHA1 Message Date
Robert Shaw
dbe5588554 [ Misc ] non-uniform quantization via compressed-tensors for Llama (#6515) 2024-07-18 22:39:18 -04:00