Dynamic Load Balancing Algorithm for Heterogeneous Hadoop Cluster

机译：异构Hadoop集群的动态负载平衡算法

获取原文

页面导航

摘要
著录项
相似文献
相关主题

摘要

Hadoop is a MapReduce open source implementation [1]. In homogeneous environment MapReduce can complete the parallel computing without major obstacles. load imbalance in the cluster is caused by heterogeneous nodes. We propose a dynamic load balancing model for heterogeneous clusters in this paper. In this a monitoring module is used to collect the real time information of each node. Load balancing is achieved by allocating the data dynamically based on computing capability and current load of a node. The results indicate the proposed algorithm reduced the execution time and balancing the load in the nodes of a cluster is achieved.

机译：Hadoop是一个MapReduce开源实现[1]。在同质环境中，MapReduce可以完成并行计算，没有主要障碍。群集中的负载不平衡是由异构节点引起的。我们提出了一种用于本文的异构簇的动态负载平衡模型。在此，在监视模块用于收集每个节点的实时信息。通过基于节点的计算能力和当前负载来动态地分配数据来实现负载平衡。结果表明所提出的算法减少了执行时间并平衡群集的节点中的负载。

著录项

来源
《International Conference on Advanced Technologies in Intelligent Control, Environment, Computing and Communication Engineering》|2019年|1 v.|共5页
会议地点
作者
D C Vinutha; G T Raju;
展开▼
作者单位

展开▼
会议组织
原文格式 PDF
正文语种
中图分类计算技术、计算机技术;
关键词
Task analysis; Heuristic algorithms; Clustering algorithms; Load management; Load modeling; Computational modeling; Monitoring;

机译：任务分析;启发式算法;聚类算法;负载管理;负载建模;计算建模;监控;

相似文献

外文文献
中文文献
专利

1. A sliding window-based dynamic load balancing for heterogeneous Hadoop clusters [J] . Yang Liu, Weizhe Jing, Youbo Liu, Concurrency, practice and experience . 2017,第3期

机译：异构Hadoop集群基于滑动窗口的动态负载平衡
2. A Content-based Dynamic Load-Balancing Algorithm for Heterogeneous Web Server Cluster [J] . Zhang Lin, Li Xiao-ping, Su Yuan Computer Science and Information Systems . 2010,第1期

机译：基于内容的异构Web服务器集群动态负载均衡算法
3. A load index and load balancing algorithm for heterogeneous clusters [J] . Jose Luis Bosque, Pablo Toharia, Oscar D. Robles, Journal of supercomputing . 2013,第3期

机译：异构集群的负载指数和负载均衡算法
4. Dynamic Load Balancing Algorithm for Heterogeneous Hadoop Cluster [C] . D C Vinutha, G T Raju International Conference on Advanced Technologies in Intelligent Control, Environment, Computing and Communication Engineering . 2019

机译：异构Hadoop集群的动态负载平衡算法
5. Designing a scalable dynamic load-balancing algorithm for pipelined single program multiple data applications on a non-dedicated heterogeneous network of workstations. [D] . Osman, Ashraf. 2003

机译：为工作站的非专用异构网络上的流水线单程序多个数据应用程序设计可伸缩的动态负载平衡算法。
6. Improved support vector machine classification algorithm based on adaptive feature weight updating in the Hadoop cluster environment [O] . Jianfang Cao, Min Wang, Yanfei Li, 2012

机译：Hadoop集群环境中基于自适应特征权重更新的改进支持向量机分类算法
7. A Content-based Dynamic Load-Balancing Algorithm for Heterogeneous Web Server Cluster [O] . Zhang Lin, Li Xiao-ping, Su Yuan 2014

机译：基于内容的异构Web服务器集群动态负载均衡算法

Dynamic Load Balancing Algorithm for Heterogeneous Hadoop Cluster

摘要

著录项

相似文献

相关主题

期刊订阅