首页> 外文会议>International Conference on Agro-geoinformatics >Archiving System of Rural Land Contractual Management Right Data using Multithreading and Distributed Storage Technology
【24h】

Archiving System of Rural Land Contractual Management Right Data using Multithreading and Distributed Storage Technology

机译:使用多线程和分布式存储技术归档农村土地合同管理权限数据

获取原文

摘要

Due to the fact that volume of the national rural land contract management right data is large, the data are in different formats, the data types are many, and each single file is small, it introduces great challenges to the data transmission in distributed storage system. Data transmission rate is extremely slow, as most of data is small. This article aims to solve the data transmission problem when the rural land contract management right data is archived to the distributed storage system, and to further improve the efficiency of data backup. Firstly, according to the characteristics of rural land contract management right data, this article designs the framework model of distributed storage system, to archive the unstructured original data files. Secondly, based on a single-threaded tool RoboCopy, which is archiving tool and can be used to preserve a subset of data on target systems, this paper uses multi thread technology and design an archiving algorithm. The archiving algorithm assigns each copy task to multiple threads or multiple RoboCopy functions, so that multiple threads are processed concurrently and independently. Although the origin single thread copy ability is better that each thread in multiple threads in the archiving process, but the overall multi-threaded concurrent processing is superior to the origin single thread. Thirdly, using the multiple threaded archiving algorithm, this article design and implement an archiving system for administrator to archive the rural land contract management rights data. The archiving system contains a control flow for administrator to select administrative division, select data list, fill in ID, upload data list, select source data path, add notes, upload data, check consistence, and preserve the data to storage system. Lastly, this article uses and distributed storage system, presents a multi thread transmission algorithm, designs and implements an archiving system based on multithread technology. Finally, this paper takes the real rural land contract management right in Liuhe District of Jiangsu Province as an experiment dataset, and examines the overall effectiveness and usability of the archiving system. The experiment results demonstrate that multithreading technology can reduce the time of data transmission, and improve the efficiency of archiving process effectively; by increasing the number of threads, the efficiency of the data backup system reaches a stable optimal value in a certain number of threads, and although the number of threads is increased indefinitely, the performance of the archiving system will no longer improve. The archiving system designed in this paper can well solve the problem of storage of rural land contract management right data, which provides reference experience and assistance for similar research and application.
机译:由于国家农村土地契约管理权的数量很大,数据种类不同,数据类型很多,每个文件都很小,它对分布式存储系统中的数据传输引入了巨大挑战。数据传输速率极慢,因为大多数数据都很小。本文旨在解决当农村土地合同管理权限被存档到分布式存储系统时的数据传输问题,并进一步提高数据备份的效率。首先,根据农村土地合同管理权限的特点,本文设计了分布式存储系统的框架模型,归档非结构化的原始数据文件。其次,基于单螺纹工具Robocopy,它是归档工具,可用于保留目标系统上的数据子集,本文使用多线程技术并设计归档算法。归档算法将每个复制任务分配给多个线程或多个RoboCopy函数,以便同时和独立地处理多个线程。虽然原点单线拷贝能力更好,但是在存档过程中多个线程中的每个线程都更好,但整体多线程并发处理优于原始单线线程。第三,使用多线程归档算法,本文设计和实施管理员归档系统,以归档农村土地合同管理权限数据。归档系统包含管理员的控制流,以选择管理划分,选择数据列表,填写ID,上传数据列表,选择源数据路径,添加备注,上载数据,检查一致性,并将数据保存到存储系统。最后,本文使用和分布式存储系统,呈现多线程传输算法,设计并实现基于多线程技术的归档系统。最后,本文以江苏省六河区的真正农村土地合同管理为实验数据集,研究了归档系统的整体效力和可用性。实验结果表明,多线程技术可以减少数据传输的时间,有效提高归档过程的效率;通过增加线程的数量,数据备份系统的效率在一定数量的线程中达到稳定的最佳值,尽管线程数无限期增加,但归档系统的性能将不再改善。本文设计的归档系统可以很好地解决农村土地契约管理权限数据的存储问题,为类似的研究和应用提供参考经验和援助。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号