biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[V1] Prompt logprobs + APC compatibility; prompt logprobs reqs cannot fill APC (#13949)

Browse Source
This commit is contained in:
afeldman-nm
2025-03-07 20:48:12 -05:00
committed by GitHub
parent 66e16a038e
commit ef64044079
9 changed files with 291 additions and 161 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
tests/v1/engine/utils.py
View File

@@ -30,9 +30,6 @@ FULL_STRINGS = [
STOP_STRINGS = ["I love working on", "company by far", "brother in"]
PROMPT_LEN = 5
PLP_APC_UNSUPPORTED_MSG = ("Prefix caching with prompt logprobs not yet "
"supported on VLLM V1.")
random.seed(42)