biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
324a3119b0d738b6fd2e1e5b46ff144411491b4c
vllm/examples/offline_inference/batch_llm_inference.py
Richard Liaw 8cac35ba43 [Ray] Improve documentation on batch inference (#16609) 
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
2025-04-16 22:19:26 -07:00

2.9 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink