SC22 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Workshops Archive

Optimizing the Bruck Algorithm for All-to-All Communication


Workshop: Women in HPC: Diversifying the HPC Community and Engaging Male Allies

Authors: Ke Fan (University of Alabama, Birmingham)


Abstract: In this work, we focus on efficiently generalizing the Bruck algorithm to non-uniform all-to-all data exchange. We present two alternative techniques for extending the Bruck algorithm to support non-uniform data distributions: padded Bruck and two-phase Bruck. In padded Bruck, we convert the non-uniform communication pattern into a uniform one by padding data messages into equal-sized buffers. Our other implementation, the two-phase Bruck, uses a meta-data exchange phase and a monolithic working buffer to facilitate non-uniform all-to-all data exchange. Moreover, we also performed experimental investigation of the tunable Bruck algorithm with varying radix-r. We demonstrated that the Bruck algorithm with r = sqrt(P) (P : total number of processes) is the most effective in most cases.


Website:






Back to Women in HPC: Diversifying the HPC Community and Engaging Male Allies Archive Listing



Back to Full Workshop Archive Listing