Lessons Learned on MPI+Threads Communication
SessionState of the Practice
DescriptionHybrid MPI+threads programming is gaining prominence, but, in practice, applications perform slower with it compared to the MPI everywhere model. The most critical challenge to the parallel efficiency of MPI+threads applications is slow MPI_THREAD_MULTIPLE performance. MPI libraries have recently made significant strides on this front, but to exploit their capabilities, users must expose the communication parallelism in their MPI+threads applications. MPI 4.0 provides users with new performance-oriented options to do so, but the evaluation of these new mechanisms shows that they pose several challenges. An alternative design is MPI Endpoints. In this paper, we present a comparison of the different designs from the perspective of MPI’s end-users: domain scientists and application developers. We evaluate the mechanisms on metrics beyond performance such as usability, scope, and portability. Based on the lessons learned, we make a case for a future direction.
Event Type
Paper
TimeThursday, 17 November 20222pm - 2:30pm CST
LocationC146
Recorded
Extreme Scale Computing
Memory Systems
Parallel Programming Systems
State of the Practice
TP
Archive
view