首页> 外文会议>Database Systems for Advanced Applications >Towards Automated Analysis of Connections Network in Distributed Stream Processing System
【24h】

Towards Automated Analysis of Connections Network in Distributed Stream Processing System

机译:面向分布式流处理系统中连接网络的自动化分析

获取原文
获取原文并翻译 | 示例

摘要

Not so long ago data warehouses were used to process data sets loaded periodically during ETL process (Extraction, Transformation and Loading). We could distinguish two kinds of ETL processes: full and incremental. Now we often have to process real-time data and analyse them almost on-the-fly, so the analyses are always up to date. There are many possible applications for real-time data warehouses. In most cases two features are important: delivering data to the warehouse as quick as possible, and not losing any tuple in case of failures. In this paper we describe an architecture for gathering and processing data from geographically distributed data sources and we define a method for analysing properties of the connections structure, finding the weakest points in case of single and multiple node failures. At the end of the paper our future plans are described briefly.
机译:不久之前,数据仓库用于处理在ETL过程(提取,转换和加载)中定期加载的数据集。我们可以区分两种ETL流程:完整的和增量的。现在,我们经常不得不处理实时数据并几乎实时地对其进行分析,因此分析始终是最新的。实时数据仓库有许多可能的应用程序。在大多数情况下,两个功能很重要:尽快将数据传输到仓库,以及在发生故障时不丢失任何元组。在本文中,我们描述了一种用于收集和处理来自地理分布的数据源的数据的体系结构,并定义了一种分析连接结构属性的方法,可在单节点和多节点故障的情况下找到最薄弱的点。在本文的结尾,我们简要描述了我们的未来计划。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号