[Speculators][Speculative Decoding] Fix gpt-oss eagle3 accuracy issue (#25406)

Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
This commit is contained in:
jiahanc
2025-09-23 12:44:35 -07:00
committed by GitHub
parent 24fab45d96
commit d5944d5146
6 changed files with 79 additions and 17 deletions

View File

@@ -1003,6 +1003,7 @@ class ModelConfig:
self.quantization = quantization_override
break
quant_method = quant_method if quant_method != "" else None
# Verify quantization configurations.
if self.quantization is None:
self.quantization = quant_method