MPI to Go: Container Clusters for MPI Applications
Abstract
Container-based virtualization has been investigated as an attractive solution to achieve isolation, flexibility and efficiency in a wide range of computational applications. In High Performance Computing, many applications rely on clusters to run multiple communicating processes using MPI (Message Passing Interface) communication protocol. Container clusters based on Docker Swarm or Kubernetes may bring benefits to HPC scenarios, but deploying MPI applications over such platforms is a challenging task. In this work, we propose a self-content Docker Swarm platform capable of supporting MPI applications, and validate it though the performance characterization of a meteorological scientific application.