• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>IEEE Transactions on Parallel and Distributed Systems >Scalable Design and Implementations for MPI Parallel Overlapping I/O
【24h】

Scalable Design and Implementations for MPI Parallel Overlapping I/O

机译：MPI并行重叠I / O的可扩展设计和实现

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

We investigate the message passing interface input/output (MPI I/O) implementation issues for two overlapping access patterns: the overlaps among processes within a single I/O operation and the overlaps across a sequence of I/O operations. The former case considers whether I/O atomicity can be obtained in the overlapping regions. The latter focuses on the file consistency problem on parallel machines with client-side file caching enabled. Traditional solutions for both overlapping I/O problems use whole file or byte-range file locking to ensure exclusive access to the overlapping regions and bypass the file system cache. Unfortunately, not only can file locking serialize I/O, but it can also increase the aggregate communication overhead between clients and I/O servers. For atomicity, we first differentiate MPI's requirements from the portable operating system interface (POSIX) standard and propose two scalable approaches, graph coloring and process-rank ordering, which can resolve access conflicts and maintain I/O parallelism. For solving the file consistency problem across multiple I/O operations, we propose a method called persistent file domains, which tackles cache coherency with additional information and coordination to guarantee safe cache access without using file locks
机译：我们研究了两种重叠访问模式的消息传递接口输入/输出（MPI I / O）实现问题：单个I / O操作中的进程之间的重叠以及一系列I / O操作中的重叠。前一种情况考虑是否可以在重叠区域中获得I / O原子性。后者着重于启用了客户端文件缓存的并行计算机上的文件一致性问题。针对重叠I / O问题的传统解决方案使用整个文件或字节范围的文件锁定，以确保对重叠区域的独占访问并绕过文件系统缓存。不幸的是，文件锁定不仅会序列化I / O，而且还会增加客户端和I / O服务器之间的总通信开销。对于原子性，我们首先将MPI的需求与便携式操作系统接口（POSIX）标准区分开来，并提出了两种可扩展的方法，即图形着色和进程等级排序，可以解决访问冲突并保持I / O并行性。为了解决跨多个I / O操作的文件一致性问题，我们提出了一种称为持久性文件域的方法，该方法通过附加信息和协调来解决缓存一致性问题，以确保在不使用文件锁的情况下安全地访问缓存

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号