Dramatic Changes in HPC Storage

At the 2017 CHPC conference I gave a plenary lecture looking at developments in HPC storage past and future.

Dramatic changes for Storage and IO in HPC are upon us. Bridging several tiers of storage is becoming a necessity, software will need to improve dramatically to keep up with faster memory and storage devices, and far more nodes will be supplying storage resources. We will talk about roles for technologies such as containers, file systems, object storage and give an overview of a broad class of new data movement software and analogies with the cloud. This is an area with many exciting opportunities and presently only a handful of solutions are available or under development.

Intel has published a beautiful image outlining some of the developments

The numbers required by some of the future deployments, in particular the SKA Science Data Processor always draw attention.

The slides for CHPC IO.

Occam Lecture: Extreme Computing For Ska

The OCCAM lectures at Merton College in Oxford are given each Term. In October 2017 I gave a talk about SKA, which led me to build relationships with the Physics Department, and they helped me significantly in the organization of the workshop AI at CERN and SKA. They also rewarded me with a wonderful tour of CERN

We have slides here and a movie was created, available from Merton College’s Occam Lecture page, and on Youtube.