[MISC] Dump model runner inputs when crashing (#8305)

This commit is contained in:
Cody Yu
2024-09-11 18:12:25 -07:00
committed by GitHub
parent 3fd2b0d21c
commit a65cb16067
4 changed files with 75 additions and 1 deletions

View File

@@ -30,6 +30,15 @@ body:
</details>
validations:
required: true
- type: textarea
attributes:
label: Model Input Dumps
description: |
If you are facing crashing due to illegal memory access or other issues with model execution, vLLM may dump the problematic input of the model. In this case, you will see the message `Error in model execution (input dumped to /tmp/err_xxx.pkl)`. If you see this message, please zip the file (because GitHub doesn't support .pkl file format) and upload it here. This will help us to reproduce the issue and facilitate the debugging process.
placeholder: |
Upload the dumped input file.
validations:
required: false
- type: textarea
attributes:
label: 🐛 Describe the bug