sroy745 f6778620a9 Disable spec-decode + chunked-prefill for draft models with tensor parallelism > 1 (#10136) ...

Signed-off-by: Sourashis Roy <sroy@roblox.com>

2024-11-08 15:56:18 +00:00

3.1 KiB

Raw Blame History

View Raw