High Performance Storage at Exascale

Presented by

Torben Kling Petersen, HPE; Michael Hennecke, Intel; Glyn Bowden, HPE; Alex McDonald, SNIA CSTI Chair

About this talk

As the computational performance of modern supercomputers is approaching the ExaFLOPS level (10**18 floating point operations per second), the demands on the storage systems that feed these supercomputers continue to increase. On top of traditional HPC simulation workloads, more and more supercomputers are also designed to simultaneously satisfy new data centric workflows with very different I/O characteristics. Through their massive scale-out capabilities, current parallel file systems are more than able to provide the capacity and raw bandwidth that is needed at Exascale. But it can be difficult to achieve high performance for the increasingly complex data access patterns, to manage billions of small files efficiently, and to continuously feed large GPU based systems with the huge datasets that are required in ML/AI workloads. This webcast will examine the different I/O workflows seen on supercomputers today, discussing the approaches the industry is taking to support the convergence of HPC and AI workflows, and highlighting some of the innovations in both storage hardware and parallel file system software that will enable high performance storage at Exascale and beyond, discussing: • Overview of typical use cases: Numerical simulation, sensor data ingest and analysis, ML/AI, etc. • Advancements in HPC storage hardware: From HDDs to storage class memory • Solution design: HPC storage fabrics, software stacks, heterogeneity, and tiering • Workflows: How to ensure data is available in the right place at the right moment • Realities of high-performance storage management – from the perspective of end users and storage administrators

Related topics:

More from this channel

Upcoming talks (2)
On-demand talks (491)
Subscribers (16448)
With today’s pressures on lowering our carbon footprint and cost constraints within organizations, IT departments are increasingly in the front line to formulate and enact an IT strategy that greatly improves energy efficiency and the overall performance of data centers. This channel will cover the strategic issues on ‘going green’ as well as practical tips and techniques for busy IT professionals to manage their data centers. Channel discussion topics will include: - Data center efficiency, monitoring and infrastructure management; - Data center design, facilities management and convergence; - Cooling technologies and thermal management And much more