Michael Goin 65b1f121c8 [Bugfix] Fix kv_cache_dtype=fp8 without scales for FP8 checkpoints (#6761)

2024-07-25 09:46:15 -07:00

..

__init__.py

[CI/Build] Move test_utils.py to tests/utils.py (#4425)

2024-05-13 23:50:09 +09:00

test_bitsandbytes.py

[bitsandbytes]: support read bnb pre-quantized model (#5753)

2024-07-23 23:45:09 +00:00

test_compressed_tensors.py

[Misc] Support FP8 kv cache scales from compressed-tensors (#6528)

2024-07-23 04:11:50 +00:00

test_configs.py

[Kernel][Core] Add AWQ support to the Marlin kernel (#6612)

2024-07-21 19:41:42 -04:00

test_fp8.py

[Bugfix] Fix kv_cache_dtype=fp8 without scales for FP8 checkpoints (#6761)

2024-07-25 09:46:15 -07:00

test_lm_head.py

[CORE] Quantized lm-head Framework (#4442)

2024-07-02 22:25:17 +00:00

utils.py

[hardware][misc] introduce platform abstraction (#6080)

2024-07-02 20:12:22 -07:00