You are here

CoMPI: Enhancing MPI Based Applications Performance and Scalability Using Run-Time Compression.

TitleCoMPI: Enhancing MPI Based Applications Performance and Scalability Using Run-Time Compression.
Publication TypeConference Paper
Year of Publication2009
AuthorsFilgueira, R, Singh, DE, Calderón, A, Carretero, J
Conference NameEUROPVM/MPI 2009.Espoo, Finland. September 2009
Conference Start Date01/09/2009
PublisherSpringer
Conference LocationEspoo. Finland
Abstract

This paper presents an optimization of MPI communications, called CoMPI, based on run-time compression of MPI messages exchanged by applications. A broad number of compression algorithms have been fully implemented and tested for both MPI collective and point to point primitives. In addition, this paper presents a study of several compression algorithms that can be used for run-time compression, based on the datatype used by applications. This study has been validated by using several MPI benchmarks and real HPC applications. Show that, in most of the cases, using compression reduces the application communication time enhancing application performance and scalability. In this way, CoMPI obtains important improvements in the overall execution time for many of the considered scenarios.

DOI10.1007/978-3-642-03770-2_27