[Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784)

Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
2025-11-03 09:23:31 -08:00
parent 4bc400f47e
commit 2c19d96777
8 changed files with 304 additions and 11 deletions
--- a/requirements/test.txt
+++ b/requirements/test.txt
@@ -40,6 +40,8 @@ anyio==4.6.2.post1
    # via
    #   httpx
    #   starlette
+arctic-inference==0.1.0
+    # via -r requirements/test.in
 argcomplete==3.5.1
    # via datamodel-code-generator
 arrow==1.3.0