The International Conference for High Performance Computing, Networking, Storage, and Analysis
The International Conference for High Performance Computing, Networking, Storage, and Analysis
Workshop: PDSW22: 7th International Parallel Data Systems Workshop
Authors: Nicolau Manubens Gil, Simon Smart, and Tiago Quintino (European Centre for Medium-Range Weather Forecasts (ECMWF)) and Adrian Jackson (Edinburgh Parallel Computing Centre (EPCC))
Abstract: High-performance object stores are an emerging technology which offers an alternative solution in the field of HPC storage, with potential to address long-standing scalability issues in traditional distributed POSIX file systems due to excessive consistency assurance and metadata prescriptiveness.
In this presentation, we assess the performance of storing object-like data within a standard file system, where the configuration and access mechanisms have not been optimized for object access behavior, and compare with and investigate the benefits of using an object storage system. While this approach is not exploiting the file system in a standard way, this work allows us to investigate whether the underlying storage technology performance is more or less important than the software interface and infrastructure a file system or object store provides.
Back to PDSW22: 7th International Parallel Data Systems Workshop Archive Listing