Explicitly set return_dict for apply_chat_template (#33372)

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
2026-01-30 07:27:04 +00:00
parent 726d89720c
commit 9432ed8c7e
11 changed files with 22 additions and 10 deletions
--- a/examples/online_serving/token_generation_client.py
+++ b/examples/online_serving/token_generation_client.py
@@ -27,7 +27,8 @@ def main(client):
        messages,
        add_generation_prompt=True,
        enable_thinking=False,
-    )
+        return_dict=True,
+    ).input_ids
    payload = {
        "model": MODEL_NAME,
        "token_ids": token_ids,