[Bugfix] Fix for Spec model TP + Chunked Prefill (#10232)

Signed-off-by: andoorve <37849411+andoorve@users.noreply.github.com> Signed-off-by: Sourashis Roy <sroy@roblox.com> Co-authored-by: Sourashis Roy <sroy@roblox.com>
2024-11-26 09:11:16 -08:00
parent 1f6584ee85
commit db66e018ea
8 changed files with 144 additions and 72 deletions
--- a/docs/source/serving/compatibility_matrix.rst
+++ b/docs/source/serving/compatibility_matrix.rst
@@ -118,7 +118,7 @@ Feature x Feature
     - 
     - 
   * - :ref:`SD <spec_decode>`
-     - ✗
+     - ✅
     - ✅
     - ✗
     - ✅