[Feature]: Add corrupted request metric to V1 metrics system. (#27306)

Signed-off-by: atalhens <sneh.lata@nutanix.com>
This commit is contained in:
Snehlata
2025-11-06 03:15:29 +05:30
committed by GitHub
parent 65ac8d8dc4
commit e15601789b
6 changed files with 51 additions and 13 deletions

View File

@@ -168,10 +168,6 @@ class Request:
def use_structured_output(self) -> bool:
return self.structured_output_request is not None
@property
def is_output_corrupted(self) -> bool:
return self.num_nans_in_logits > 0
@property
def num_tokens(self) -> int:
return len(self._all_token_ids)