首页> 外文学位 >GPU-based mapreduce schemes for big data processing.
【24h】

GPU-based mapreduce schemes for big data processing.

机译:基于GPU的mapreduce方案用于大数据处理。

获取原文
获取原文并翻译 | 示例

摘要

MapReduce programming model and its implementations have simplified many par-allel applications. Because of the raising demand of higher computing performance, Graphics Processing Units (GPU) has been used to accelerate MapReduce in several stud-ies. Different from CPU, high GPU utilization requires not only descent parallel algo-rithm but also careful considerations of hardware details. This paper describes the devel-opment path of our MapReduce system from single GPU to multiple GPUs. Utilization of each GPU is promoted by using new GPU features such as streams and Hyper-Q. Fur-thermore, several scheduling schemes are designed to avoid blocked GPU operations. To address the challenge of Big Data, our MapReduce system handles large data sets that ex-ceed GPU and even CPU memory. Experimental results show the performance im-provement and increased scalability gained from each acceleration technique. Although our current work is specific to MapReduce, many underlying ideas are also applicable to acceleration of other GPU applications.
机译:MapReduce编程模型及其实现简化了许多并行应用程序。由于对更高的计算性能提出了更高的要求,因此图形处理单元(GPU)已被用于在多个研究对象中加速MapReduce。与CPU不同,高GPU利用率不仅要求下降并行算法,还需要仔细考虑硬件细节。本文介绍了MapReduce系统从单个GPU到多个GPU的发展路径。通过使用新的GPU功能(例如流和Hyper-Q)来促进每个GPU的利用率。此外,设计了几种调度方案来避免阻塞的GPU操作。为了应对大数据的挑战,我们的MapReduce系统可处理超过GPU甚至CPU内存的大型数据集。实验结果表明,每种加速技术均可以提高性能并提高可伸缩性。尽管我们当前的工作是针对MapReduce的,但许多基础思想也适用于其他GPU应用程序的加速。

著录项

  • 作者

    Chen, Yi.;

  • 作者单位

    Arkansas State University.;

  • 授予单位 Arkansas State University.;
  • 学科 Computer Science.
  • 学位 M.S.
  • 年度 2013
  • 页码 165 p.
  • 总页数 165
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号