Run:ai model streamer add GCS package support (#24909)

Signed-off-by: Peter Schuurman <psch@google.com>
2025-10-01 20:59:13 -07:00
parent 169313b9f8
commit be22bb6f3d
6 changed files with 54 additions and 9 deletions
--- a/docs/models/extensions/runai_model_streamer.md
+++ b/docs/models/extensions/runai_model_streamer.md
@@ -24,6 +24,13 @@ vllm serve s3://core-llm/Llama-3-8b \
    --load-format runai_streamer
 ```

+To run model from Google Cloud Storage run:
+
+```bash
+vllm serve gs://core-llm/Llama-3-8b \
+    --load-format runai_streamer
+```
+
 To run model from a S3 compatible object store run:

 ```bash