SC22 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Workshops Archive

Understanding Strong Scaling on GPUs Using Empirical Performance Saturation Size


Workshop: 2022 International Workshop on Performance Portability and Productivity (P3HPC)

Authors: David Eberius, David Rogers, and Philip Roth (Oak Ridge National Laboratory (ORNL))


Abstract: The roofline model provides a concise overview of the maximum performance capabilities of a given computer system through a combination of peak memory bandwidth and compute performance rates. The increasing complexity of scheduling and caches in recent GPUs, however, has introduced complicated performance variability that is not captured by arithmetic intensity alone. This work examines the effect of problem size and GPU launch configurations on roofline performance for V100, A100, MI100, and MI250X graphics processing units. We introduce an extended roofline model that takes problem size into account, and find that strong scaling on GPUs can be characterized by “saturation problem sizes” as additional key metrics. Saturation problem sizes break up a plot of GPU performance vs. problem size into three distinct performance regimes– size-limited, cache-bound, and DRAM-bound. With our extended roofline model, we are able to provide a robust view of these performance regimes across recent GPU architectures.





Back to 2022 International Workshop on Performance Portability and Productivity (P3HPC) Archive Listing



Back to Full Workshop Archive Listing