首页> 外文会议>2015 International Conference on Smart and Sustainable City and Big Data >The impact of web data processing on computer property: A study based on Hadoop
【24h】

The impact of web data processing on computer property: A study based on Hadoop

机译:Web数据处理对计算机属性的影响:基于Hadoop的研究

获取原文
获取原文并翻译 | 示例

摘要

With the rapid development of information technology, the demand of computer system's ability in computing and processing Big Data is increasing day by day. Currently, data generated by applications in all walks of life are growing explosively. How to deal with this data efficiently has been a new development direction of analysis and application in Big Data. Previous work is usually conducted in a single PC. Hadoop is a distributed software framework in processing Big Data, and it has the advantage of cheapness, high reliability, high efficiency, high fault tolerance. In this paper, we take parsing Web page for an example, studying on the change of computer property when program running in a single PC and in a Hadoop cluster respectively, to prove that Hadoop has the superiority in handling parsing Web page compared with previous work.
机译:随着信息技术的飞速发展,计算机系统对大数据的计算和处理能力的需求日益增长。当前,各行各业的应用程序生成的数据正在爆炸性增长。如何有效处理这些数据已经成为大数据分析和应用的新发展方向。以前的工作通常是在一台PC上进行的。 Hadoop是用于处理大数据的分布式软件框架,具有价格便宜,可靠性高,效率高,容错能力强的优点。本文以解析网页为例,研究程序在单台PC和Hadoop集群中分别运行时计算机属性的变化,证明Hadoop与以前的工作相比,在处理解析网页方面具有优势。 。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号