Climbing the Summit and Pushing the Frontier of Mixed Precision Benchmarks at Extreme Scale
DescriptionThe rise of machine learning (ML) applications and their use of mixed precision to perform interesting science are driving forces behind AI for science on HPC. The convergence of ML and HPC with mixed precision offers the possibility of transformational changes in computational science.

The HPL-AI benchmark is designed to measure the performance of mixed precision arithmetic as opposed to the HPL benchmark which measures double precision performance. Pushing the limits of systems at extreme scale is nontrivial ---little public literature explores optimization of mixed precision computations at this scale.

In this work, we demonstrate how to scale up the HPL-AI benchmark on the pre-exascale Summit and exascale Frontier systems at the Oak Ridge Leadership Computing Facility (OLCF) with a cross-platform design. We present the implementation, performance results, and a guideline of optimization strategies employed for delivering portable performance on both AMD and NVIDIA GPUs at extreme scale.
Event Type
Paper
TimeThursday, 17 November 20222:30pm - 3pm CST
LocationC146
Registration Categories
TP
Tags
Extreme Scale Computing
Memory Systems
Parallel Programming Systems
State of the Practice
Session Formats
Recorded
Session Evaluation give feedback
Back To Top Button