[Speculative decoding] Initial spec decode docs (#5400)

2024-06-11 10:15:40 -07:00
parent 246598a6b1
commit 4c2ffb28ff
2 changed files with 76 additions and 0 deletions
--- a/docs/source/index.rst
+++ b/docs/source/index.rst
@@ -90,6 +90,7 @@ Documentation
   models/engine_args
   models/lora
   models/vlm
+   models/spec_decode
   models/performance

 .. toctree::