[Doc][3/N] Reorganize Serving section (#11766)

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2025-01-07 11:20:01 +08:00
parent d93d2d74fd
commit 8ceffbf315
40 changed files with 248 additions and 133 deletions
--- a/docs/source/features/spec_decode.md
+++ b/docs/source/features/spec_decode.md
@@ -1,6 +1,6 @@
 (spec-decode)=

-# Speculative decoding
+# Speculative Decoding

 ```{warning}
 Please note that speculative decoding in vLLM is not yet optimized and does