• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文会议>High performance computing >Output Performance Study on a Production Petascale Filesystem
【24h】

Output Performance Study on a Production Petascale Filesystem

机译：生产Petascale文件系统的输出性能研究

获取原文
获取原文并翻译 | 示例
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

This paper reports our observations from a top-tier supercomputer Titan and its Lustre parallel file stores under production load. In summary, we find that supercomputer file systems are highly variable across the machine at fine time scales. This variability has two major implications. First, stragglers lessen the benefit of coupled I/O parallelism (striping). Peak median output bandwidths are obtained with parallel writes to many independent files, with no striping or write-sharing of files across clients (compute nodes). I/O parallelism is most effective when the application—or its I/O middleware system—distributes the I/O load so that each client writes separate files on multiple targets, and each target stores files for multiple clients, in a balanced way. Second, our results suggest that the potential benefit of dynamic adaptation is limited. In particular, it is not fruitful to attempt to identify "good spots" in the machine or in the file system: component performance is driven by transient load conditions, and past performance is not a useful predictor of future performance. For example, we do not observe regular diurnal load patterns.
机译：本文报告了我们在生产负荷下从顶级超级计算机Titan及其Luster并行文件存储中获得的观察结果。总而言之，我们发现超级计算机文件系统在良好的时间范围内在整个计算机上变化很大。这种可变性具有两个主要含义。首先，散乱的人减少了耦合I / O并行性（条带化）的好处。通过并行写入许多独立文件可以获得峰值中值输出带宽，而不会在客户端（计算节点）之间对文件进行条带化或写共享。当应用程序或其I / O中间件系统分配I / O负载，以便每个客户端在多个目标上写入单独的文件，并且每个目标以均衡的方式为多个客户端存储文件时，I / O并行性最有效。第二，我们的结果表明动态适应的潜在利益是有限的。特别是，尝试识别机器或文件系统中的“好地方”并不是徒劳的：组件性能由瞬态负载条件驱动，过去的性能对于将来的性能不是有用的预测指标。例如，我们没有观察到规律的昼夜负荷模式。

著录项

  • 来源
    《High performance computing》|2017年|187-200|共14页
  • 会议地点 Frankfurt(DE)
  • 作者

    Bing Xie; Jeffrey S. Chase; David Dillow; Scott Klasky; Jay Lofstead; Sarp Oral; Norbert Podhorszki;

  • 作者单位

    Department of Computer Science, Duke University, Durham, USA;

    Department of Computer Science, Duke University, Durham, USA;

    Oak Ridge National Laboratory, Oak Ridge, USA;

    Center for Computing Research, Sandia National Laboratories,Albuquerque, USA;

    Center for Computing Research, Sandia National Laboratories,Albuquerque, USA;

    Center for Computing Research, Sandia National Laboratories,Albuquerque, USA;

    Center for Computing Research, Sandia National Laboratories,Albuquerque, USA;

  • 会议组织
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

    Parallel I/O; Petascale filesystem; Output performance;

    机译：并行I / O Petascale文件系统；输出性能;

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号