...
首页> 外文期刊>International journal of web services research >An Efficient MapReduce Computing Model for Imprecise Applications
【24h】

An Efficient MapReduce Computing Model for Imprecise Applications

机译:针对不精确应用的高效MapReduce计算模型

获取原文
获取原文并翻译 | 示例
           

摘要

Optimizing the Map process is important for the improvement of the MapReduce performance. Many efforts have been devoted into the problem to design more efficient scheduling strategies. However, there exists a kind of MapReduce applications, named imprecise applications, where the imprecise results based on part of map tasks can satisfy the requirements of imprecise applications and thus the job processes can be completed when enough map tasks are processed. According to the feature of imprecise applications, the authors propose an improved MapReduce model, named MapCheckReduce, which can terminate the map process when the requirements of an imprecise application is satisfied. Compared to MapReduce, a Check mechanism and a set of extended programming interfaces are added to MapCheckReduce. The Check mechanism receives and analyzes messages submitted by completed map tasks and then determines whether to terminate the map phase according to the analysis results. The programming interfaces are used by the programmers to define the termination conditions of the map process. A data-prefetching mechanism is designed and implemented in MapCheckReduce which can improve the performance of MapCheckReduce effectively. The MapCheckReduce prototype has been implemented and experiment results verify the feasibility and effectiveness of MapCheckReduce.
机译:优化Map流程对于提高MapReduce性能非常重要。已经为解决这个问题付出了很多努力,以设计更有效的调度策略。但是,存在一种MapReduce应用程序,称为不精确应用程序,其中基于部分地图任务的不精确结果可以满足不精确应用程序的要求,因此,当处理足够的地图任务时,就可以完成作业过程。根据不精确应用程序的特性,作者提出了一种改进的MapReduce模型,称为MapCheckReduce,该模型可以在满足不精确应用程序的需求时终止映射过程。与MapReduce相比,MapCheckReduce添加了Check机制和一组扩展的编程接口。检查机制接收并分析已完成的地图任务提交的消息,然后根据分析结果确定是否终止地图阶段。程序员使用编程接口来定义映射过程的终止条件。在MapCheckReduce中设计并实现了一种数据预取机制,可以有效提高MapCheckReduce的性能。已经实现了MapCheckReduce原型,实验结果验证了MapCheckReduce的可行性和有效性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号