biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Fix shape comment in extract_hidden_states example (#38723)

Browse Source 
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
This commit is contained in:
Fynn Schmitt-Ulms
2026-04-01 10:29:33 -04:00
committed by GitHub
parent 7cf56a59a2
commit fa246d5231
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/offline_inference/extract_hidden_states.py
View File

@@ -54,5 +54,5 @@ with tempfile.TemporaryDirectory() as tmpdirname:
print("Extracted token ids:", token_ids) # Matches prompt token ids
print(
"Extracted hidden states shape:", hidden_states.shape
) # [num_hidden_layers, prompt len, hidden size]
) # [prompt len, num_hidden_layers, hidden size]
print("Extracted hidden states:", hidden_states)