首页> 外文会议>ICA3PP 2014 >MRFS: A Distributed Files System with Geo-replicated Metadata
【24h】

MRFS: A Distributed Files System with Geo-replicated Metadata

机译:MRFS:具有Geo-Repled Metadata的分布式文件系统

获取原文

摘要

Distributed file system is one of the key blocks of data centers. With the advance in geo-replicated storage systems across data centers, both system scale and user scale are becoming larger and larger. Then, a single metadata server in distributed file system may lead to capacity bottleneck and high latency without considering locality. In this paper, we present the design and implementation of MRFS (Metadata Replication File System), a distributed file system with hierarchical and efficient distributed metadata management, which introduces multiple metadata servers (MDS) and an additional namespace server (NS). Metadata is divided into non-overlapping parts and stored on MDS in which the creation operation is raised, while namespace and directory information is maintained in NS. Such a hierarchical design not only achieves high scalability but also provides low-latency because it satisfies a majority of requests in local MDS. To address hotspot issues and flash crowds, the system supports flexible and configurable metadata replication among MDSs. Evaluation results show that our system MRFS is effective and efficient, and the replication mechanism brings substantial local visit at the cost of affordable memory overhead under various scenarios.
机译:分布式文件系统是数据中心的密钥块之一。通过跨数据中心的地理复制存储系统的前进,系统规模和用户规模都变得越来越大。然后,分布式文件系统中的单个元数据服务器可能导致容量瓶颈和高延迟而不考虑局部性。在本文中,我们介绍了MRFS(元数据复制文件系统)的设计和实现,具有分层和有效分布式元数据管理的分布式文件系统,它引入了多个元数据服务器(MDS)和附加名称空间服务器(NS)。元数据被分为非重叠部分并存储在其中,所述创建动作被升高,而命名空间和目录信息保存在NS MDS。这种层级设计不仅实现了高可扩展性,而且还提供了低延迟,因为它满足本地MDS中的大部分要求。要解决热点问题和闪存人群,系统支持MDS之间的灵活和可配置的元数据复制。评估结果表明,我们的系统MRFS有效且高效,复制机制以各种情况下的经济实惠的记忆开销成本带来了大量的本地访问。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号