biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix][Model] Attempt to fix eagle in V0. (#18978)

Browse Source 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
This commit is contained in:
Gregory Shtrasberg
2025-06-02 11:15:53 -04:00
committed by GitHub
parent 20133cfee2
commit ca2f6b9c30
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/config.py
View File

@@ -2595,7 +2595,8 @@ class SpeculativeConfig:
else: else:
eagle_config = EAGLEConfig( eagle_config = EAGLEConfig(
self.draft_model_config.hf_config, self.draft_model_config.hf_config,
method=self.method) method=self.method,
model_type="eagle")
self.draft_model_config.hf_config = eagle_config self.draft_model_config.hf_config = eagle_config
if (self.num_speculative_tokens is not None if (self.num_speculative_tokens is not None