biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[EncoderCacheManager] Remove unnecessary copy (#32800)

Browse Source 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
This commit is contained in:
Lukas Geiger
2026-01-24 14:28:57 +00:00
committed by GitHub
parent bc0d291bfe
commit 5fa0f6efa9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/v1/core/encoder_cache_manager.py
View File

@@ -237,7 +237,7 @@ class EncoderCacheManager:
Typically called when a request is finished, cancelled, or aborted. Typically called when a request is finished, cancelled, or aborted.
""" """
input_ids = self.get_cached_input_ids(request).copy() input_ids = self.get_cached_input_ids(request)
for input_id in input_ids: for input_id in input_ids:
self.free_encoder_input(request, input_id) self.free_encoder_input(request, input_id)