High Performance Storage at Exascale

Presented by

Torben Kling Petersen, HPE; Michael Hennecke, Intel; Glyn Bowden, HPE; Alex McDonald, SNIA CSTI Chair

About this talk

As the computational performance of modern supercomputers is approaching the ExaFLOPS level (10**18 floating point operations per second), the demands on the storage systems that feed these supercomputers continue to increase. On top of traditional HPC simulation workloads, more and more supercomputers are also designed to simultaneously satisfy new data centric workflows with very different I/O characteristics. Through their massive scale-out capabilities, current parallel file systems are more than able to provide the capacity and raw bandwidth that is needed at Exascale. But it can be difficult to achieve high performance for the increasingly complex data access patterns, to manage billions of small files efficiently, and to continuously feed large GPU based systems with the huge datasets that are required in ML/AI workloads. This webcast will examine the different I/O workflows seen on supercomputers today, discussing the approaches the industry is taking to support the convergence of HPC and AI workflows, and highlighting some of the innovations in both storage hardware and parallel file system software that will enable high performance storage at Exascale and beyond, discussing: • Overview of typical use cases: Numerical simulation, sensor data ingest and analysis, ML/AI, etc. • Advancements in HPC storage hardware: From HDDs to storage class memory • Solution design: HPC storage fabrics, software stacks, heterogeneity, and tiering • Workflows: How to ensure data is available in the right place at the right moment • Realities of high-performance storage management – from the perspective of end users and storage administrators

Related topics:

More from this channel

Upcoming talks (4)
On-demand talks (2231)
Subscribers (55558)
The Enterprise Architecture channel presents the next generation of Enterprise IT: recognizing the strategic importance of digital transformation and the data center to make companies more nimble and competitive. These presentations will help demanding IT and BizOps professionals achieve flexibility, scalability and performance with reduced risk and complexity.