• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文会议>2013 IEEE 29th Symposium on Mass Storage Systems and Technologies >Optimizing a hybrid SSD/HDD HPC storage system based on file size distributions
【24h】

Optimizing a hybrid SSD/HDD HPC storage system based on file size distributions

机译：根据文件大小分布优化混合SSD / HDD HPC存储系统

获取原文
获取原文并翻译 | 示例
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

We studied file size distributions from 65 customer installations and a total of nearly 600 million files. We found that between 25% and 90% of all files are 64 Kbytes or less in size, yet these files account for less than 3% of the capacity in most cases. In extreme cases 5% to 15% of capacity is occupied by small files. We used this information to size the ratio of SSD to HDD capacity on our latest HPC storage system. Our goal is to automatically allocate all of the block-level and file-level metadata, and all of the small files onto SSD, and use the much cheaper HDD storage for large file extents. The unique storage blade architecture of the Panasas system that couples SSD, HDD, processor, memory, and networking into a scalable building block makes this approach very effective. Response time measured by metadata intensive benchmarks is several times better in our systems that couple SSD and HDD. The paper describes the measurement methodology, the results from our customer survey, and the performance benefits of our approach.
机译：我们研究了来自65个客户安装的文件大小分布以及总共近6亿个文件。我们发现，所有文件的25％至90％的大小为64 KB或更小，但是在大多数情况下，这些文件所占容量不到3％。在极端情况下，小文件会占用5％至15％的容量。我们使用此信息来确定最新HPC存储系统上SSD与HDD容量的比率。我们的目标是自动将所有块级和文件级元数据以及所有小文件分配到SSD上，并对大文件范围使用便宜得多的HDD存储。 Panasas系统独特的存储刀片架构将SSD，HDD，处理器，内存和网络耦合到一个可扩展的构建块中，使这种方法非常有效。在我们结合SSD和HDD的系统中，通过元数据密集型基准测得的响应时间要好几倍。本文介绍了测量方法，客户调查的结果以及该方法的性能优势。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号