• 主题
高级搜索  >
历史搜索 清空历史
首页> 美国政府科技报告 >Interactive Query Processing in Big Data Systems: A Cross Industry Study of MapReduce Workloads.
【24h】

Interactive Query Processing in Big Data Systems: A Cross Industry Study of MapReduce Workloads.

机译：大数据系统中的交互式查询处理：mapReduce工作负载的跨行业研究。

获取原文
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Within the past few years, organizations in diverse industries have adopted MapReduce-based systems for large-scale data processing. Along with these new users, important new workloads have emerged which feature many small, short and increasingly interactive jobs in addition to the large long-running batch jobs for which MapReduce was originally designed. As interactive, large- scale query processing (e.g. OLAP) is a strength of the RDBMS community, it is important that lessons from that field be carried over and applied where possible in this new domain. However, these new workloads have not yet been described in the literature. We ll this gap with an empirical analysis of MapReduce traces from six separate business-critical deployments inside Facebook and at Cloudera customers in e-commerce, telecommunications, media, and retail. Our key contribution is a characterization of new MapReduce workloads which are driven in part by interactive analysis, and which make heavy use of SQL-like programming frameworks on top of MapReduce. These workloads display diverse behaviors which invalidate prior assumptions about MapReduce such as uniform data access, regular diurnal patterns, and prevalence of large jobs. A secondary contribution is a first step towards creating a TPC- like data processing benchmark for MapReduce.

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号