• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文会议>Proof of Designed Reliability >Dynamic load distribution in the Borealis stream processor
【24h】

Dynamic load distribution in the Borealis stream processor

机译：Borealis流处理器中的动态负载分配

获取原文
获取原文并翻译 | 示例
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Distributed and parallel computing environments are becoming cheap and commonplace. The availability of large numbers of CPU's makes it possible to process more data at higher speeds. Stream-processing systems are also becoming more important, as broad classes of applications require results in real-time. Since load can vary in unpredictable ways, exploiting the abundant processor cycles requires effective dynamic load distribution techniques. Although load distribution has been extensively studied for the traditional pull-based systems, it has not yet been fully studied in the context of push-based continuous query processing. In this paper, we present a correlation based load distribution algorithm that aims at avoiding overload and minimizing end-to-end latency by minimizing load variance and maximizing load correlation. While finding the optimal solution for such a problem is NP-hard, our greedy algorithm can find reasonable solutions in polynomial time. We present both a global algorithm for initial load distribution and a pair-wise algorithm for dynamic load migration.
机译：分布式并行计算环境正在变得便宜和普遍。大量CPU的可用性使得可以以更高的速度处理更多的数据。流处理系统也变得越来越重要，因为各种各样的应用程序需要实时获得结果。由于负载可能以不可预测的方式变化，因此利用丰富的处理器周期需要有效的动态负载分配技术。尽管已经针对传统的基于拉的系统对负载分配进行了广泛的研究，但尚未在基于推式的连续查询处理的上下文中对负载分配进行充分的研究。在本文中，我们提出了一种基于相关的负载分配算法，该算法旨在通过最小化负载变化和最大化负载相关性来避免过载并最小化端到端延迟。虽然找到此类问题的最佳解决方案是NP-hard，但我们的贪婪算法仍可以在多项式时间内找到合理的解决方案。我们介绍了用于初始负载分配的全局算法和用于动态负载迁移的成对算法。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号