[Frontend] Expose custom args in OpenAI APIs (#16862)

Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
This commit is contained in:
afeldman-nm
2025-06-18 20:41:11 -04:00
committed by GitHub
parent ed33349738
commit dfada85eee
3 changed files with 44 additions and 14 deletions

View File

@@ -198,8 +198,8 @@ class SamplingParams(
processor which only retains scores for the given token ids.
Defaults to None.
extra_args: Arbitrary additional args, that can be used by custom
sampling implementations. Not used by any in-tree sampling
implementations.
sampling implementations, plugins, etc. Not used by any in-tree
sampling implementations.
"""
n: int = 1