XtremDew: a platform for cooperative tasks and data schedulers

Mohamed Labidi; Oleg Lodygensky; Gilles FedakMaher KhemakhemMohamed Jemni

首页> 外文期刊>International Journal of High Performance Computing and Networking >XtremDew: a platform for cooperative tasks and data schedulers

【24h】

XtremDew: a platform for cooperative tasks and data schedulers

机译：XtremDew: a platform for cooperative tasks and data schedulers

获取原文

获取原文并翻译 | 示例

掌桥外文数据库（机构版） >>

开具论文收录证明 >>

文献代查 >>

页面导航

摘要
著录项
相关主题

摘要

With the emergence of big data, data scheduling is becoming an important field of research in distributed computing. Software data scheduler often relies on data management policies that can be defined by the user and provide high level features. Such advanced features become necessary nowadays to execute data intensive applications, and this implies that data and task schedulers should cooperate closely to address the large data processing issue and ensure an optimal distribution of data intensive applications. In this paper, we propose XtremDew, the data and task cooperative scheduler platform. We deal with the distribution of the optical character recognition (OCR) on large scale. We show, in particular, the benefit of the focus on data scheduling to distribute our OCR application. We build the data driven distributing platform by combining two existing middleware: BitDew, as the data scheduler, and XtremWeb-HEP, as the task scheduler. Taking advantage of both middlewares, XtremDew provides new features. To evaluate the efficiency of our approach, we compare different strategies of scheduling tasks and data and we present several scenarios that illustrate the benefits of using XtremDew to execute data-intensive applications.

著录项

来源
《International Journal of High Performance Computing and Networking》 |2020年第1期|55-66|共12页
作者
Mohamed Labidi; Oleg Lodygensky; Gilles FedakMaher KhemakhemMohamed Jemni;
展开▼
作者单位

LaTICE, University of Tunis;

IN2P3, University of Paris XI;

INRIA, University of LyonComputer Science Department, Faculty of Computing and Information Technology, King Abdul-Aziz University, KSA;

展开▼
收录信息
原文格式 PDF
正文语种英语
中图分类理论、方法;
关键词
big data; data intensive application; cooperative middleware; big data processing;

XtremDew: a platform for cooperative tasks and data schedulers

摘要

著录项

相关主题

期刊订阅