Workshops Archive

Co-Scheduling Ensembles of In Situ Workflows

Workshop: The 17th Workshop on Workflows in Support of Large-Scale Science (WORKS22)

Authors: Tu Mai Anh Do and Loïc Pottier (University of Southern California, Information Sciences Institute); Rafael Ferreira da Silva and Frédéric Suter (Oak Ridge National Laboratory (ORNL)); Silvina Caíno-Lores and Michela Taufer (University of Tennessee); and Ewa Deelman (University of Southern California, Information Sciences Institute)

Abstract: Molecular dynamics (MD) simulations are widely used to study large-scale molecular systems. However, reaching the necessary timescale to detect rare processes is challenging, even with modern supercomputers. To overcome the timescale limitation, the simulation of a long MD trajectory is replaced by multiple short-range simulations executed simultaneously in an ensemble. Analyses are usually co-scheduled with these simulations to efficiently process large volumes of data in situ. Executing a workflow ensemble of simulations and their in situ analyses requires sophisticated management of computational resources so that they are not slowing down each other. In this paper, we propose an efficient method to co-schedule and allocate resources for a workflow ensemble such that the makespan is minimized. We evaluate the proposed approach using an accurate simulator based on the WRENCH simulation framework. Results demonstrate the significance of co-scheduling simulations and in situ analyses that couple data together to benefit from data locality.

Back to The 17th Workshop on Workflows in Support of Large-Scale Science (WORKS22) Archive Listing

Back to Full Workshop Archive Listing