文献阅读《xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep Learning》

we survey the current state-of-the-art collective communication libraries (namely xCCL, including NCCL, oneCCL, RCCL, MSCCL, ACCL, and Gloo), with a f