The paper proposes a novel approach for optimizing performance of all-to-all collective communication by taking advantage of concurrency available in modern networks such as Infiniband or Quadrics. Using the MPI AllGather operation as an example, we describe how network concurrency can be exploited in an optimized implementation of this operation. For example, compared to leading MPI implementations for a 32-KB message on 128 processors, our new algorithm yields a 65% improvement on the Infiniband at Virginia Tech and an 89% improvement on the Quadrics cluster at Pacific Northwest National Laboratory.
展开▼
机译：本文提出了一种新颖的方法，以利用诸如Infiniband或Quadrics之类的现代网络中可用的并发性来优化所有所有人的集体通信的性能。以MPI AllGather操作为例，我们描述了如何在此操作的优化实现中利用网络并发性。例如，与领先的MPI在128个处理器上实现32 KB消息的实现相比，我们的新算法在Virginia Tech的Infiniband上提高了65％，在Pacific Northwest National Laboratory的Quadrics集群上提高了89％。
展开▼
