vllm/vllm/model_executor/parallel_utils at ca81ff5196b2fa82b7a9d553cd6e30eab9e72aca - vllm

Files

History

youkaichao ca81ff5196 [Core] manage nccl via a pypi package & upgrade to pt 2.2.1 (#3805 )

2024-04-04 10:26:19 -07:00

__init__.py

2023-10-02 15:36:09 -07:00

communication_op.py

2024-03-27 00:33:26 -07:00

custom_all_reduce.py

2024-03-25 07:59:47 -07:00

parallel_state.py

2024-03-27 00:33:26 -07:00

pynccl_utils.py

2024-03-29 23:26:44 +00:00

pynccl.py

2024-04-04 10:26:19 -07:00

README.md

2023-06-17 03:07:40 -07:00

utils.py

2023-11-15 22:50:41 -08:00

The files in this folder are ported from Megatron-LM. We only keep the codes that are used in inference.