...
首页> 外文期刊>Sustainability >Energy-Aware Cluster Reconfiguration Algorithm for the Big Data Analytics Platform Spark
【24h】

Energy-Aware Cluster Reconfiguration Algorithm for the Big Data Analytics Platform Spark

机译:大数据分析平台Spark的能源感知集群重新配置算法

获取原文
           

摘要

The development of Cloud computing and data analytics technologies has made it possible to process big data faster. Distributed computing schemes, for instance, can help to reduce the time required for data analysis and thus enhance its efficiency. However, fewer researchers have paid attention to the problem of the high-energy consumption of the cluster, placing a heavy burden on the environment, especially when the number of nodes is extremely large. As a consequence, the principle of sustainable development is violated. Considering this problem, this paper proposes an approach that can be applied to remove less-efficient nodes or to migrate over-utilized nodes of the cluster so as to adjust the load of the cluster properly and thereby achieve the goal of energy conservation. Furthermore, in order to testify the performance of the proposed methodology, we present the simulation results implemented by using CloudSim.
机译:云计算和数据分析技术的发展使更快地处理大数据成为可能。例如,分布式计算方案可以帮助减少数据分析所需的时间,从而提高其效率。但是,很少有研究人员关注群集的高能耗问题,这给环境带来了沉重负担,尤其是在节点数非常多的情况下。结果,违反了可持续发展的原则。考虑到这一问题,本文提出了一种可用于去除效率较低的节点或迁移集群中过度使用的节点的方法,以适当地调整集群的负载,从而达到节能的目的。此外,为了验证所提出方法的性能,我们提供了使用CloudSim实现的仿真结果。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号