Signed-off-by: Elias Ellison <elias.ellison@gmail.com> Signed-off-by: eellison <elias.ellison@gmail.com>
Current vLLM config is not set.
torch.cuda.synchronize()
torch.accelerator.synchronize
mypy