biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Revert #24446 and #26168 (#26332)

Browse Source 
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
This commit is contained in:
Thomas Parnell
2025-10-08 00:38:19 +02:00
committed by GitHub
parent caf8b1c084
commit 31a4b3e6c4
5 changed files with 10 additions and 117 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
tests/entrypoints/llm/test_generate.py
View File

@@ -85,11 +85,10 @@ def test_max_model_len():
num_total_tokens = len(output.prompt_token_ids) + len(
output.outputs[0].token_ids
)
# Total tokens must not exceed max_model_len + 1 (the last token can be
# generated with the context length equal to the max model length)
# Total tokens must not exceed max_model_len.
# It can be less if generation finishes due to other reasons (e.g., EOS)
# before reaching the absolute model length limit.
assert num_total_tokens <= max_model_len + 1
assert num_total_tokens <= max_model_len
def test_log_stats():