elvischenv 24d0c9e6ed [NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703) ...

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2025-08-22 22:09:05 +00:00

..

compressed_tensors

Fix nvfp4 swizzling (#23140)

2025-08-21 16:54:50 +00:00

kernels

[CPU] Refactor CPU W8A8 scaled_mm (#23071)

2025-08-21 09:34:24 +08:00

quark

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

utils

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703)

2025-08-22 22:09:05 +00:00

__init__.py

[Kernel/Quant] Remove the original marlin format and qqq (#23204)

2025-08-20 15:13:36 -04:00

auto_round.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

awq_marlin.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

awq_triton.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

awq.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

base_config.py

[Quant] [Bugfix] Fix quantization config matching with hf_to_vllm_mapper (#20046)

2025-07-01 19:20:34 +09:00

bitblas.py

[Bugfix] Add proper comparison for package versions (#22314)

2025-08-06 20:31:03 -07:00

bitsandbytes.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

deepgemm.py

[Feature] Integrate SM100 DeepGEMM support (#20087)

2025-07-10 20:18:05 -07:00

deepspeedfp.py

[Bugfix] Add proper comparison for package versions (#22314)

2025-08-06 20:31:03 -07:00

experts_int8.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

fbgemm_fp8.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00

fp8.py

[Bug] Fix R1 Accuracy 0 Bug (#23294)

2025-08-21 13:11:28 -04:00

gguf.py

[Quantization] Allow GGUF quantization to skip unquantized layer (#23188)

2025-08-22 13:04:22 -06:00

gptq_bitblas.py

[Bugfix] Add proper comparison for package versions (#22314)

2025-08-06 20:31:03 -07:00

gptq_marlin_24.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

gptq_marlin.py

fix: gptq marlin weight loading failure (#23066)

2025-08-17 15:56:07 -07:00

gptq.py

feat: Add Support GPTQ Quantization MOE on ROCM vllm serve (#21733)

2025-08-01 21:12:19 -04:00

hqq_marlin.py

[Kernel] [Quantization] Add MXFP4 and bias support for marlin kernel (#22428)

2025-08-14 11:23:22 -07:00

inc.py

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)

2025-07-16 15:33:41 -04:00

input_quant_fp8.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00

ipex_quant.py

[Bugfix] Add proper comparison for package versions (#22314)

2025-08-06 20:31:03 -07:00

kv_cache.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

modelopt.py

[NVIDIA] Add SM100 Flashinfer Cutlass MoE fp8 backend (#22357)

2025-08-19 18:01:53 -04:00

moe_wna16.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

mxfp4.py

Use Blackwell FlashInfer MXFP4 MoE by default if available (#23008)

2025-08-18 15:25:49 -07:00

neuron_quant.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

ptpc_fp8.py

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830)

2025-07-11 04:56:28 +00:00

rtn.py

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra arguments from modular kernel methods. (#22035)

2025-08-15 14:46:00 -04:00

schema.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

torchao.py

[Quant] [Bugfix] Fix quantization config matching with hf_to_vllm_mapper (#20046)

2025-07-01 19:20:34 +09:00

tpu_int8.py

[TPU] Add support for online w8a8 quantization (#22425)

2025-08-08 23:12:54 -07:00