The framework's deep_gemm_warmup calls get_fused_moe_quant_config which accesses w13_input_scale etc. Setting them to None caused TypeError: float / NoneType. Keep scales (small tensors) and only free the large weight tensors.
The framework's deep_gemm_warmup calls get_fused_moe_quant_config which accesses w13_input_scale etc. Setting them to None caused TypeError: float / NoneType. Keep scales (small tensors) and only free the large weight tensors.