[Model Runner V2] Some code simplification (#36929)
Signed-off-by: Nick Hill <nickhill123@gmail.com>
This commit is contained in:
@@ -57,10 +57,7 @@ SpeculativeMethod = Literal[
|
||||
EagleModelTypes,
|
||||
NgramGPUTypes,
|
||||
]
|
||||
RejectionSampleMethod = Literal[
|
||||
"strict",
|
||||
"probabilistic",
|
||||
]
|
||||
RejectionSampleMethod = Literal["strict", "probabilistic"]
|
||||
|
||||
|
||||
@config
|
||||
|
||||
Reference in New Issue
Block a user