[V1][Structured Output] Clear xgrammar compiler object when engine core shut down to avoid nanobind leaked warning (#16954)

Signed-off-by: shen-shanshan <467638484@qq.com>
This commit is contained in:
Shanshan Shen
2025-04-24 21:15:03 +08:00
committed by GitHub
parent 21f4f1c9a4
commit b724afe343
5 changed files with 17 additions and 0 deletions

View File

@@ -107,3 +107,7 @@ class StructuredOutputManager:
# np.ndarray, because that is much more efficient for serialization
# and deserialization when sending this to the GPU workers.
return bitmask_tensor.numpy()
def clear_backend(self) -> None:
if self.backend is not None:
self.backend.destroy()