vllm/vllm/model_executor/parallel_utils at 756b30a5f30ee08b97243e1077419d8d74442b02 - vllm

Files

youkaichao 756b30a5f3 [Core][Test] move local_rank to the last arg with default value(#3711 )

[Core][Test] move local_rank to the last arg with default value to keep api compatible (#3711)

2024-03-28 21:19:45 -07:00

__init__.py

2023-10-02 15:36:09 -07:00

communication_op.py

2024-03-27 00:33:26 -07:00

custom_all_reduce.py

2024-03-25 07:59:47 -07:00

parallel_state.py

2024-03-27 00:33:26 -07:00

pynccl_utils.py

2024-03-28 21:19:45 -07:00

pynccl.py

2024-03-28 21:19:45 -07:00

README.md

2023-06-17 03:07:40 -07:00

utils.py

2023-11-15 22:50:41 -08:00

The files in this folder are ported from Megatron-LM. We only keep the codes that are used in inference.