首页> 外文学位 >Designing scalable and high performance one sided communication middleware for modern interconnects.
【24h】

Designing scalable and high performance one sided communication middleware for modern interconnects.

机译:为现代互连设计可扩展的高性能单侧通信中间件。

获取原文
获取原文并翻译 | 示例

摘要

High-end computing (HEC) systems are enabling scientists and engineers to tackle grand challenge problems in their respective domains and make significant contributions to their fields. Examples of such problems include astro-physics, earthquake analysis, weather prediction, nanoscience modeling, multiscale and multiphysics modeling, biological computations, computational fluid dynamics, etc. There has been great emphasis on designing, building and deploying ultra scale HEC systems to provide true petascale performance for these grand challenge problems. At the same time, Clusters built from commodity PCs are being predominantly used as main stream tools for high-end computing owing to their cost-effectiveness and easy availability.;Communication subsystem plays a pivotal role in achieving scalable performance in clusters. Of late there has been a lot of interest in one-sided communication model and they are seen as a viable option for petascale applications. The one-sided communication provides good potential for computation communication overlap. In order to provide high performance and scalability, the one-sided communication subsystem needs to be designed to leverage the advanced capabilities of the modern interconnects.;In this dissertation we study and explore various aspects of one-sided communication like zero-copy, overlap, reduced remote CPU utilization, latency hiding techniques, and non-contiguous data transfers in middleware libraries. We improved the passive synchronization design to use RDMA atomic operations that provides high overlap capability. We also proposed a hybrid design that extends the above approach to optimize intra-node communications as well. We have also explored the use of remote completion semantics for RDMA operations in InfiniBand to improve the performance of fence synchronization. To optimize non-contiguous data communication, we proposed novel zero-copy designs using InfiniBand scatter/gather operations with reduced remote CPU utilization. Designs using RDMA atomic primitives have been proposed to improve the performance of read-modify-write operations. Further we have also proposed latency hiding techniques that uses non-blocking semantics and aggregation mechanisms.
机译:高端计算(HEC)系统使科学家和工程师能够解决各自领域中的严峻挑战,并为其领域做出重大贡献。这样的问题的例子包括天体物理学,地震分析,天气预报,纳米科学建模,多尺度和多物理场建模,生物计算,计算流体动力学等。人们一直非常重视设计,构建和部署超大规模HEC系统,以提供真实的这些挑战性问题的千万亿次性能。同时,基于商用PC的集群由于具有成本效益和易用性,因此被广泛用作高端计算的主流工具。通信子系统在实现集群的可扩展性能方面起着关键作用。最近,人们对单面通信模型产生了浓厚的兴趣,它们被认为是petascale应用程序的可行选择。单面通信为计算通信重叠提供了良好的潜力。为了提供高性能和可伸缩性,需要设计单侧通信子系统以利用现代互连的先进功能。本文研究和探索单侧通信的各个方面,例如零复制,重叠。 ,降低了远程CPU利用率,延迟隐藏技术以及中间件库中的不连续数据传输。我们改进了被动同步设计,以使用RDMA原子操作来提供高重叠功能。我们还提出了一种混合设计,该设计扩展了上述方法以优化节点内通信。我们还探索了在InfiniBand中将远程完成语义用于RDMA操作的方法,以提高篱笆同步的性能。为了优化非连续数据通信,我们提出了使用InfiniBand分散/收集操作的新型零拷贝设计,并减少了远程CPU的使用。已经提出了使用RDMA原子基元的设计,以提高读取-修改-写入操作的性能。此外,我们还提出了使用非阻塞语义和聚合机制的延迟隐藏技术。

著录项

  • 作者单位

    The Ohio State University.;

  • 授予单位 The Ohio State University.;
  • 学科 Engineering Computer.
  • 学位 Ph.D.
  • 年度 2009
  • 页码 184 p.
  • 总页数 184
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号