rasmith a41351f363 [Quantization][FP8] Add support for FP8 models with input_scale for output projection and QK quantization (#15734) ...

Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

2025-04-25 00:45:02 -07:00

..

compressed_tensors

[FEAT] [ROCm]: AITER Fused MOE V1 Support (#16752)

2025-04-25 11:06:50 +08:00

kernels

[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036)

2025-04-22 09:01:36 +01:00

quark

[Quantization][FP8] Add support for FP8 models with input_scale for output projection and QK quantization (#15734)

2025-04-25 00:45:02 -07:00

utils

[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036)

2025-04-22 09:01:36 +01:00

__init__.py

[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036)

2025-04-22 09:01:36 +01:00

aqlm.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

awq_marlin.py

[Kernel] moe wna16 marlin kernel (#14447)

2025-04-14 20:05:22 -07:00

awq_triton.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

awq.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

base_config.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

bitblas.py

[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036)

2025-04-22 09:01:36 +01:00

bitsandbytes.py

[Quantization][V1] BitsAndBytes support V1 (#15611)

2025-03-28 10:12:47 +08:00

deepspeedfp.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

experts_int8.py

Upstream Llama4 Support to Main (#16113)

2025-04-07 08:06:27 -07:00

fbgemm_fp8.py

[Quantization][FP8] Adding support for fp8 gemm layer input in fp8 (#14578)

2025-03-28 02:58:16 +00:00

fp8.py

[Quantization][FP8] Add support for FP8 models with input_scale for output projection and QK quantization (#15734)

2025-04-25 00:45:02 -07:00

gguf.py

Upstream Llama4 Support to Main (#16113)

2025-04-07 08:06:27 -07:00

gptq_bitblas.py

[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation - BitBLAS (#6036)

2025-04-22 09:01:36 +01:00

gptq_marlin_24.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

gptq_marlin.py

[Kernel] moe wna16 marlin kernel (#14447)

2025-04-14 20:05:22 -07:00

gptq.py

[Misc] set single whitespace between log sentences (#13771)

2025-02-25 10:26:12 +08:00

hqq_marlin.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

ipex_quant.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

kv_cache.py

[Quantization][FP8] Add support for FP8 models with input_scale for output projection and QK quantization (#15734)

2025-04-25 00:45:02 -07:00

marlin.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

modelopt.py

[Kernel] Add ModelOpt FP4 Checkpoint Support (#12520)

2025-03-12 05:13:11 +00:00

moe_wna16.py

Upstream Llama4 Support to Main (#16113)

2025-04-07 08:06:27 -07:00

neuron_quant.py

[Misc] set single whitespace between log sentences (#13771)

2025-02-25 10:26:12 +08:00

ptpc_fp8.py

[FP8] Refactor apply_fp8_linear and apply_fp8_linear_generic into an object (#14390)

2025-03-07 05:20:16 +00:00

qqq.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00

schema.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

torchao.py

Torchao (#14231)

2025-04-07 19:39:28 -04:00

tpu_int8.py

[Quant] Add SupportsQuant to phi3 and clip (#13104)

2025-02-15 19:28:33 -08:00