[Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901)

Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com> Co-authored-by: Michael Goin <mgoin64@gmail.com>
2025-12-17 06:35:28 +08:00
parent eaa82a709a
commit ce96857fdd
16 changed files with 729 additions and 513 deletions
--- a/vllm/model_executor/layers/quantization/gptq_marlin.py
+++ b/vllm/model_executor/layers/quantization/gptq_marlin.py
@@ -181,7 +181,7 @@ class GPTQMarlinConfig(QuantizationConfig):

    @classmethod
    def get_min_capability(cls) -> int:
-        return 80
+        return 75

    @classmethod
    def get_config_filenames(cls) -> list[str]: