Research Article

Collective communication: theory, practice, and experience

  1. Ernie Chan1,*,
  2. Marcel Heimlich1,
  3. Avi Purkayastha2,
  4. Robert van de Geijn1

Article first published online: 5 JUL 2007

DOI: 10.1002/cpe.1206

Issue

Concurrency and Computation: Practice and Experience

Concurrency and Computation: Practice and Experience

Volume 19, Issue 13, pages 1749–1783, 10 September 2007

Additional Information

How to Cite

Chan, E., Heimlich, M., Purkayastha, A. and van de Geijn, R. (2007), Collective communication: theory, practice, and experience. Concurrency Computat.: Pract. Exper., 19: 1749–1783. doi: 10.1002/cpe.1206

Author Information

  1. 1

    Department of Computer Sciences, The University of Texas at Austin, Austin, TX 78712, U.S.A.

  2. 2

    Texas Advanced Computing Center, The University of Texas at Austin, Austin, TX 78712, U.S.A.

*Department of Computer Sciences, The University of Texas at Austin, Austin, TX 78712, U.S.A.

Publication History

  1. Issue published online: 7 AUG 2007
  2. Article first published online: 5 JUL 2007
  3. Manuscript Accepted: 10 MAR 2007
  4. Manuscript Revised: 24 JAN 2007
  5. Manuscript Received: 14 SEP 2006

Funded by

  • National Science Foundation. Grant Number: CCF-0540926

SEARCH

SEARCH BY CITATION

ARTICLE TOOLS

View Full Article (HTML) Get PDF (2139K)

Keywords:

  • collective communication;
  • distributed-memory architecture;
  • clusters

Abstract

We discuss the design and high-performance implementation of collective communications operations on distributed-memory computer architectures. Using a combination of known techniques (many of which were first proposed in the 1980s and early 1990s) along with careful exploitation of communication modes supported by MPI, we have developed implementations that have improved performance in most situations compared to those currently supported by public domain implementations of MPI such as MPICH. Performance results from a large Intel Xeon/Pentium 4 (R) processor cluster are included. Copyright © 2007 John Wiley & Sons, Ltd.

View Full Article (HTML) Get PDF (2139K)