首页> 外文期刊>Procedia Computer Science >A method for reliably managing files with RNS in multi Data Grids
【24h】

A method for reliably managing files with RNS in multi Data Grids

机译:一种在多数据网格中使用RNS可靠地管理文件的方法

获取原文
           

摘要

This paper describes a method for reliably managing files distributed in different kinds of Data Grids with RNS (Resource Namespace Service). RNS provides hierarchical namespace management for name-to-resource mapping as a key technology when using Grid resources for different kinds of middleware. We define attribute expressions in XML for the RNS entries and give algorithms to access distributed files stored within different kinds of Data Grids. The volume of digital data and the size of an individual file are increasing due to the introduction of high-resolution images, high-definition audiovisual files, etc. The reliable storage of such large files is becoming problematic with whole file replication as a failure in the integrity of the file is difficult to localise. Our method involves managing large files in Data Grids by splitting them into smaller units in a traceable manner and then managing the smaller units. The RNS catalog service contains EPR (Endpoint Reference) and metadata that describe the original locations as well as the checksum values. The example in this paper shows how our Grid application can retrieve the actual file locations and the checksum values from the RNS service via SAGA (A Simple API for Grid Applications). An application can access the distributed files as though they were files in the local file-system without worrying about the underlying Data Grids.This approach can be used with various Data Grid systems to enhance file reliability.
机译:本文介绍了一种使用RNS(资源命名空间服务)可靠地管理分布在各种数据网格中的文件的方法。当将Grid资源用于不同种类的中间件时,RNS提供用于名称到资源映射的分层名称空间管理作为一项关键技术。我们为RNS条目定义XML的属性表达式,并提供算法来访问存储在不同类型的数据网格中的分布式文件。由于引入了高分辨率图像,高清视听文件等,数字数据的数量和单个文件的大小都在增加。随着整个文件复制的失败,此类大文件的可靠存储正成为一个问题。文件的完整性很难定位。我们的方法涉及通过以可跟踪的方式将大型文件拆分为较小的单元,然后再管理较小的单元来管理数据网格中的大型文件。 RNS目录服务包含EPR(端点参考)和描述原始位置以及校验和值的元数据。本文中的示例说明了我们的Grid应用程序如何通过SAGA(一种适用于Grid应用程序的简单API)从RNS服务中检索实际文件位置和校验和值。应用程序可以像访问本地文件系统中的文件一样访问分布式文件,而不必担心底层的数据网格。此方法可以与各种数据网格系统一起使用,以增强文件的可靠性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号