vllm/docs/source/models/adding_model.rst at 4f2ad1113553211778640c648e11f5aa2e03dbd4 - vllm - Gitea: Git with a cup of tea

biondizzle/vllm

Files

Zhuohan Li fd4ea8ef5c Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221 )

2024-01-03 11:30:22 -08:00

6.2 KiB

Raw Blame History

View Raw