Hadoop Extensions for Distributed Computing on Reconfigurable Active SSD Clusters

ABDULRAHMAN KAITOUA; HAZEM HAJJ; MAZEN A. R. SAGHIR; HASSAN ARTAIL; HAITHAM AKKARY; MARIETTE AWAD; MAGEDA SHARAFEDDINE; KHALEEL MERSHAD

首页> 外文期刊>ACM Transactions on Architecture and Code Optimization >Hadoop Extensions for Distributed Computing on Reconfigurable Active SSD Clusters

【24h】

Hadoop Extensions for Distributed Computing on Reconfigurable Active SSD Clusters

机译：用于可重配置Active SSD群集上的分布式计算的Hadoop扩展

获取原文

获取原文并翻译 | 示例

掌桥外文数据库（机构版） >>

开具论文收录证明 >>

文献代查 >>

页面导航

摘要
著录项
相似文献
相关主题

摘要

In this article, we propose new extensions to Hadoop to enable clusters of reconfigurable active solid-state drives (RASSDs) to process streaming data from SSDs using FPGAs. We also develop an analytical model to estimate the performance of RASSD clusters running under Hadoop. Using the Hadoop RASSD platform and network simulators, we validate our design and demonstrate its impact on performance for different workloads taken from Stanford's Phoenix MapReduce project. Our results show that for a hardware acceleration factor of 20 ×, compute-intensive workloads processing 153MB of data can run up to 11× faster than a standard Hadoop cluster.

机译：在本文中，我们提出了Hadoop的新扩展，以使可重新配置的活动固态驱动器（RASSD）的群集能够使用FPGA处理来自SSD的流数据。我们还开发了一个分析模型来估计在Hadoop下运行的RASSD群集的性能。通过使用Hadoop RASSD平台和网络模拟器，我们验证了我们的设计并展示了其对斯坦福Phoenix MapReduce项目中不同工作负载的性能的影响。我们的结果表明，对于20倍的硬件加速因子，处理153 MB数据的计算密集型工作负载运行速度比标准Hadoop集群快11倍。

著录项

来源
《ACM Transactions on Architecture and Code Optimization》 |2014年第2期|共26页
作者
ABDULRAHMAN KAITOUA; HAZEM HAJJ; MAZEN A. R. SAGHIR; HASSAN ARTAIL; HAITHAM AKKARY; MARIETTE AWAD; MAGEDA SHARAFEDDINE; KHALEEL MERSHAD;
展开▼
作者单位

展开▼
收录信息
原文格式 PDF
正文语种 eng
中图分类计算技术、计算机技术;
关键词
Reconfigurable Computing; RASSD; Hadoop; Data-intensive computing; Middleware; Active storage;

机译：可重配置计算;RASSD;Hadoop;数据密集型计算;中间件;活动存储;

相似文献

外文文献
中文文献
专利

1. Hadoop Extensions for Distributed Computing on Reconfigurable Active SSD Clusters [J] . ABDULRAHMAN KAITOUA, HAZEM HAJJ, MAZEN A. R. SAGHIR, ACM Transactions on Architecture and Code Optimization . 2014,第2期

机译：用于可重配置Active SSD群集上的分布式计算的Hadoop扩展
2. Towards distributed acceleration of image processing applications using reconfigurable active SSD clusters: a case study of seismic data analysis [J] . Mageda Sharafeddin, Hmayag Partamian, Mariette Awad, International Journal of High Performance Computing and Networking . 2018,第4期

机译：使用可重新配置的Active SSD集群向图像处理应用的分布加速度：地震数据分析的案例研究
3. Fault prediction for distributed computing Hadoop clusters using real-time higher order differential inputs to SVM: Zedacross [J] . International journal of information and computer security . 2020,第2a3期

机译：使用SVM的实时高阶差分输入进行分布式计算Hadoop集群的故障预测：Zedacross
4. A Distributed Reconfigurable Active SSD Platform for Data Intensive Applications [C] . Abbani Noor, Ali Ali, Otoom DoaA Al, 2011 IEEE International Conference on High Performance Computing and Communications . 2011

机译：适用于数据密集型应用程序的分布式可重新配置的有源SSD平台
5. Design and implementation of distributed mobile computing platform using hadoop. [D] . Pandhe, Shraddha. 2013

机译：使用hadoop的分布式移动计算平台的设计与实现。
6. Hydra: a scalable proteomic search engine which utilizes the Hadoop distributed computing framework [O] . Steven Lewis, Attila Csordas, Sarah Killcoyne, 2012

机译：Hydra：可扩展的蛋白质组搜索引擎利用Hadoop分布式计算框架
7. Hadoop Extensions for Distributed Computing on Reconfigurable Active SSD Clusters [O] . Abdulrahman Kaitoua, Hazem Hajj, Mazen A. R. Saghir, 2014

机译：在可重构的活动SSD集群上分布式计算的Hadoop扩展

Hadoop Extensions for Distributed Computing on Reconfigurable Active SSD Clusters

摘要

著录项

相似文献

相关主题

期刊订阅