biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

[Bugfix] Fix granite speech shape validation (#21762)

Browse Source 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Cyrus Leung
2025-07-29 02:19:21 +08:00
committed by GitHub
parent ec261b0291
commit e17a4d3bf9
1 changed files with 4 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
vllm/model_executor/models/granite_speech.py
View File

@@ -64,14 +64,15 @@ class GraniteSpeechAudioInputs(TensorSchema):
Dimensions: Dimensions:
- b: Batch size - b: Batch size
- nf: Number of audio features (variable length) - fi: Number of input features from the Mel spectrogram.
- fo: Number of output features, i.e. the embedding size.
- 160: Fixed feature dimension for Mel spectrogram features - 160: Fixed feature dimension for Mel spectrogram features
""" """
input_features: Annotated[torch.Tensor, TensorShape("b", "nf", 160)] input_features: Annotated[torch.Tensor, TensorShape("b", "fi", 160)]
"""Audio input features.""" """Audio input features."""
input_features_mask: Annotated[torch.Tensor, TensorShape("b", "nf")] input_features_mask: Annotated[torch.Tensor, TensorShape("b", "fo")]
"""Mask for variable length audio features.""" """Mask for variable length audio features."""
audio_embed_sizes: Annotated[list[int], TensorShape("b")] audio_embed_sizes: Annotated[list[int], TensorShape("b")]