The International Conference for High Performance Computing, Networking, Storage, and Analysis
The International Conference for High Performance Computing, Networking, Storage, and Analysis
Workshop: First Combined International Workshop on Interactive Urgent Supercomputing
Authors: Marcin Copik (ETH Zürich)
Abstract: HPC is dominated by batch systems and rigid programming models. Jobs specify static resource allocation and wait to be scheduled, leading to node under-utilization and long wait times. In the cloud, serverless functions are used to dynamically assign computing resources and scale allocations exactly to application needs, providing resource flexibility and elastic offloading to spare data center resources. Employing the programming model of Function-as-a-Service (FaaS) would bring to HPC online computations and more elastic resource management, but functions are not ready to handle the performance requirements of HPC workloads.
In rFaaS, we propose new allocation and computation policies for serverless that benefit from faster processing and RDMA networking. rFaaS enhances traditional FaaS computing with the low latency and high throughput needed in compute- and data-intensive HPC applications. With high-performance functions, we provide opportunistic computing that uses idle resources in the HPC cluster to handle dynamic, priority, and interactive workloads.
Back to First Combined International Workshop on Interactive Urgent Supercomputing Archive Listing