首页> 外文会议>International Conference on High Performance Computing and Communications(HPCC 2005); 20050921-23; Sorrento(IT) >Optimization of Nonblocking MPI-I/O to a Remote Parallel Virtual File System Using a Circular Buffer
【24h】

Optimization of Nonblocking MPI-I/O to a Remote Parallel Virtual File System Using a Circular Buffer

机译:使用循环缓冲区优化对远程并行虚拟文件系统的无阻塞MPI-I / O

获取原文
获取原文并翻译 | 示例

摘要

Parallel computation applications output intermediate data periodically, and typically the outputs are moved to a remote computer for visualization. A flexible intermediate library named Stampi realizes seamless MPI-I/O operations both inside a computer and among computers. MPI-I/O operations to a remote computer are realized by its MPI-I/O processes which are invoked on a remote computer. To realize data-intensive I/O operations, a Parallel Virtual File System (PVFS) was supported in the MPI-I/O mechanism. MPI-I/O operations to a PVFS file system on a remote computer are available with seamless interfaces of the Stampi library. Among many kinds of I/O functions, non-blocking MPI-I/O functions provide overlap of computation with I/O operations, and visible I/O times can be minimized with them. Due to its architectural constraints and slow network, visible I/O times of them became long with an increase in the number of user processes and message data size. To minimize the times, a circular buffer system has been implemented in the mechanism. With the help of the circular buffer, the visible I/O times have been minimized effectively.
机译:并行计算应用程序定期输出中间数据,通常将输出移至远程计算机以进行可视化。名为Stampi的灵活中间库可在计算机内部和计算机之间实现无缝的MPI-I / O操作。对远程计算机的MPI-I / O操作是通过在远程计算机上调用的MPI-I / O进程来实现的。为了实现数据密集型I / O操作,MPI-I / O机制中支持并行虚拟文件系统(PVFS)。通过Stampi库的无缝接口,可以对远程计算机上的PVFS文件系统执行MPI-I / O操作。在许多类型的I / O功能中,无阻塞MPI-I / O功能提供了I / O操作的计算重叠,并且可以将可见I / O时间最小化。由于其架构限制和缓慢的网络,随着用户进程数量和消息数据大小的增加,可见的I / O时间变得很长。为了最大程度地减少时间,已在该机制中实现了循环缓冲区系统。借助循环缓冲区,有效地减少了可见的I / O时间。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号