• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文会议>Third International Workshop on Grid Computing ― GRID 2002, Nov 18, 2002, Baltimore, MD, USA >Improving the Throughput of Remote Storage Access through Pipelining
【24h】

Improving the Throughput of Remote Storage Access through Pipelining

机译：通过管道提高远程存储访问的吞吐量

获取原文
获取原文并翻译 | 示例
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Data intensive applications constitute a large and increasing share of Grid computing. However there are relatively few results on how to improve the efficiency of the basic data transfer mechanisms used to move large data set in and out of Grid nodes. In this paper we describe a simple and general technique to improve the throughput of data transfer protocols and we demonstrate it on the SDSC Storage Resource Broker (SRB), a remote storage access middleware for supercomputer applications. We achieve a maximum performance improvement of 43%/52% for remote reads/writes larger than 1MB with a few changes to the original SRB protocol. The protocol was restructured by introducing a notion of pipelining that enables the overlapping of the various stages of the data processing, such as network transfer and disk access. We present a detailed analysis of the pipelined SRB implementation and of the pipeline cost model we used to drive our design.
机译：数据密集型应用程序在网格计算中占有很大的份额，并且在不断增加。但是，关于如何提高用于将大型数据集移入和移出Grid节点的基本数据传输机制的效率的结果相对较少。在本文中，我们描述了一种简单而通用的技术来提高数据传输协议的吞吐量，并在SDSC存储资源代理（SRB）（用于超级计算机应用程序的远程存储访问中间件）上进行了演示。通过对原始SRB协议进行一些更改，对于大于1MB的远程读取/写入，我们实现了43％/ 52％的最大性能改进。通过引入流水线概念对协议进行了重组，该概念使数据处理各个阶段的重叠成为可能，例如网络传输和磁盘访问。我们对流水线SRB实施和用于驱动设计的流水线成本模型进行了详细分析。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号