Add Support for 2/3/8-bit GPTQ Quantization Models (#2330)

Browse Source

...

This commit is contained in:

CHU Tianxiang

2024-02-29 13:52:23 +08:00

committed by GitHub

parent 929b4f2973

commit 01a5d18a53

8 changed files with 1663 additions and 156 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

1306

csrc/quantization/gptq/q_gemm.cu

File diff suppressed because it is too large Load Diff