首页> 外文会议>International conference on very large data bases >Pronto: A Software-Defined Networking based System for Performance Management of Analytical Queries on Distributed Data Stores
【24h】

Pronto: A Software-Defined Networking based System for Performance Management of Analytical Queries on Distributed Data Stores

机译:Pronto:基于软件定义的网络的系统,用于分布式数据存储上的分析查询性能管理

获取原文

摘要

Nowadays data analytics applications are accessing more and more data from distributed data stores, creating large amount of data traffic on the network. Therefore, distributed analytic queries are prone to suffer from bad performance in terms of query execution time when they encounter a network resource contention, which is quite common in a shared network. Typical distributed query optimizers do not have a way to solve this problem because historically they have been treating the network underneath as a black-box: they are unable to monitor it, let alone to control it. However, we are entering a new era of software-defined networking (SDN), which provides visibility into and control of the network's state for the applications including distributed database systems. In this demonstration, we present a system, called Pronto that leverages the SDN capabilities for a distributed query processor to achieve performance improvement and differentiation for analytical queries. The system is the real implementation of our recently developed methods on commercial SDN products. The demonstration shows the shortcomings of a distributed query optimizer, which treats the underlying network as a black box, and the advantages of the SDN-based approach by allowing the users to selectively explore various relevant and interesting settings in a distributed query processing environment.
机译:如今,数据分析应用程序正在访问来自分布式数据存储的越来越多的数据,从而在网络上创建了大量的数据流量。因此,分布式分析查询在遇到网络资源争用时,在查询执行时间方面倾向于表现不佳,这在共享网络中非常普遍。典型的分布式查询优化器没有解决此问题的方法,因为从历史上看,它们一直将下面的网络视为黑匣子:他们无法监视它,更不用说对其进行控制了。但是,我们正在进入软件定义网络(SDN)的新时代,该时代为包括分布式数据库系统在内的应用程序提供对网络状态的可见性和控制。在此演示中,我们提出了一个名为Pronto的系统,该系统利用SDN功能为分布式查询处理器提供了性能提高和差异化分析查询。该系统是我们最近在商业SDN产品上开发的方法的真正实现。该演示展示了分布式查询优化器的缺点,该缺点将基础网络视为黑匣子,以及基于SDN的方法的优点,即允许用户在分布式查询处理环境中选择性地浏览各种相关且有趣的设置。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号