vllm/docs/source/models/adding_model.rst at cc63d03fbb93f2b984d38e1f5626f523c1f9f1a4 - vllm - Gitea: Git with a cup of tea

biondizzle/vllm

Files

Zhuohan Li fd4ea8ef5c Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221 )

2024-01-03 11:30:22 -08:00

6.2 KiB

Raw Blame History

View Raw