d.transposed 922d3b401b [Bugfix] Handle the edge case in detokenizer where processed tokens contain both stop str and eos token (#23938) ...

Signed-off-by: dtransposed <damian.bogunowicz@gmail.com>

2025-09-09 07:30:24 -07:00

..

__init__.py

…

conftest.py

…

test_disable_detokenization.py

…

test_min_tokens.py

[V1] support min_tokens for detokener (#22014)

2025-08-16 02:28:10 +00:00

test_stop_checker.py

…

test_stop_reason.py

…

test_stop_string_while_stop_model_terminates.py

[Bugfix] Handle the edge case in detokenizer where processed tokens contain both stop str and eos token (#23938)

2025-09-09 07:30:24 -07:00

test_stop_strings.py

…