Overcoming Metadata Management Challenges in the Era of Consolidated HPC
DescriptionMetadata management matters. Beyond its creation, you need a long-term plan for managing metadata storage and performance to get the most out of your HPC environments.
This session will explore the metadata challenges and use cases associated with all phases of HPC workloads, including data ingest, pre-processing, training, inference, analysis, and validation. Join WEKA CTO Shimon Ben-David to examine what IO profiles look like at every stage in a data pipeline, why and how these challenges become amplified when multiple HPC workloads are consolidated onto a common platform, and learn about storage strategies that can help you to overcome these metadata challenges.
This session will explore the metadata challenges and use cases associated with all phases of HPC workloads, including data ingest, pre-processing, training, inference, analysis, and validation. Join WEKA CTO Shimon Ben-David to examine what IO profiles look like at every stage in a data pipeline, why and how these challenges become amplified when multiple HPC workloads are consolidated onto a common platform, and learn about storage strategies that can help you to overcome these metadata challenges.
Presenter
Event Type
Exhibitor Forum
TimeThursday, 17 November 20222pm - 2:30pm CST
LocationD171
Recorded
TP
XO/EX