[Doc] Add docs about OpenAI compatible server (#3288)

2024-03-18 22:05:34 -07:00
parent 6a9c583e73
commit ef65dcfa6f
10 changed files with 383 additions and 161 deletions
--- a/docs/source/serving/integrations.rst
+++ b/docs/source/serving/integrations.rst
@@ -0,0 +1,11 @@
+Integrations
+------------
+
+.. toctree::
+   :maxdepth: 1
+
+   run_on_sky
+   deploying_with_kserve
+   deploying_with_triton
+   deploying_with_bentoml
+   serving_with_langchain