[Chore] Rename SchedulerConfig.chunked_prefill_enabled (#28735)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Cyrus Leung
2025-11-15 02:39:57 +08:00
committed by GitHub
parent 67187554dd
commit e2741f6cbc
9 changed files with 21 additions and 19 deletions

View File

@@ -497,7 +497,7 @@ class Scheduler(SchedulerInterface):
# chunked prefill has to be enabled explicitly to allow
# pooling requests to be chunked
if (
not self.scheduler_config.chunked_prefill_enabled
not self.scheduler_config.enable_chunked_prefill
and num_new_tokens > token_budget
):
self.waiting.pop_request()