vllm/vllm/model_executor/parallel_utils at 0ce0539d4750f9ebcd9b19d7085ca3b934b9ec67 - vllm

Files

History

youkaichao c391e4b68e [Core] improve robustness of pynccl (#3860 )

2024-04-04 16:52:12 -07:00

__init__.py

2023-10-02 15:36:09 -07:00

communication_op.py

2024-03-27 00:33:26 -07:00

custom_all_reduce.py

2024-03-25 07:59:47 -07:00

parallel_state.py

2024-03-27 00:33:26 -07:00

pynccl_utils.py

2024-03-29 23:26:44 +00:00

pynccl.py

2024-04-04 16:52:12 -07:00

README.md

2023-06-17 03:07:40 -07:00

utils.py

2023-11-15 22:50:41 -08:00

The files in this folder are ported from Megatron-LM. We only keep the codes that are used in inference.