biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity

Add llmaz as another integration (#13643)

Browse Source 
Signed-off-by: kerthcet <kerthcet@gmail.com>
This commit is contained in:
Kante Yin
2025-02-21 11:52:40 +08:00
committed by GitHub
parent 33170081f1
commit 44c33f01f3
2 changed files with 8 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
docs/source/deployment/integrations/llmaz.md Normal file
View File

@@ -0,0 +1,7 @@
(deployment-llmaz)=
# llmaz
[llmaz](https://github.com/InftyAI/llmaz) is an easy-to-use and advanced inference platform for large language models on Kubernetes, aimed for production use. It uses vLLM as the default model serving backend.
Please refer to the [Quick Start](https://github.com/InftyAI/llmaz?tab=readme-ov-file#quick-start) for more details.