The International Conference for High Performance Computing, Networking, Storage, and Analysis
The International Conference for High Performance Computing, Networking, Storage, and Analysis
Workshop: MCHPC’22: Workshop on Memory Centric High Performance Computing
Authors: Benjamin Sepanski (University of Texas), Tuowen Zhao (University of Utah), and Hans Johansen and Samuel Williams (Lawrence Berkeley National Laboratory (LBNL))
Abstract: Computations on structured grids using standard multidimensional array layouts can incur substantial data movement costs through the memory hierarchy. This presentation explores the benefits of using a framework (Bricks) to separate the complexity of data layout and optimized communication from the functional representation. To that end, we provide three novel contributions and evaluate them on several kernels taken from GENE, a phase-space fusion tokamak simulation code. We extend Bricks to support 6-dimensional arrays and kernels that operate on complex data types, and integrate Bricks with cuFFT. We demonstrate how to optimize Bricks for data reuse, spatial locality, and GPU hardware utilization achieving up to a 2.67× speedup on a single A100 GPU. We conclude with insights on how to rearchitect memory subsystems.
Back to MCHPC’22: Workshop on Memory Centric High Performance Computing Archive Listing