首页> 外文期刊>IEEE Transactions on Parallel and Distributed Systems >Dynamic querying of streaming data with the dQUOB system
【24h】

Dynamic querying of streaming data with the dQUOB system

机译:使用dQUOB系统动态查询流数据

获取原文
获取原文并翻译 | 示例
           

摘要

Data streaming has established itself as a viable communication abstraction in data-intensive parallel and distributed computations, occurring in applications such as scientific visualization, performance monitoring, and large-scale data transfer. A known problem in large-scale event communication is tailoring the data received at the consumer. It is the general problem of extracting data of interest from a data source, a problem that the database community has successfully addressed with SOL queries, a time tested, user-friendly way for noncomputer scientists to access data. By leveraging the efficiency of query processing provided by relational queries, the dQUOB system provides a conceptual relational data model and SOL query access over streaming data. Queries can be used to extract data, combine streams, and create new streams. The language augments queries with an action to enable more complex data transformations such as Fourier transforms. The dQUOB system has been applied to two large-scale distributed applications: a safety critical autonomous robotics simulation and scientific software visualization for global atmospheric transport modeling. In this paper, we present the dQUOB system and the results of performance evaluation undertaken to assess its applicability in data-intensive wide-area computations, where the benefit of portable data transformation must be evaluated against the cost of continuous query evaluation.
机译:在诸如科学可视化,性能监控和大规模数据传输之类的应用中,数据流已在数据密集型并行和分布式计算中确立为可行的通信抽象。大规模事件通信中的一个已知问题是定制在消费者处接收的数据。这是从数据源中提取感兴趣的数据的普遍问题,这是数据库社区已通过SOL查询成功解决的问题,这是一种经过时间检验的用户友好的非计算机科学家访问数据的方式。通过利用关系查询提供的查询处理效率,dQUOB系统提供了概念性的关系数据模型和对流数据的SOL查询访问。查询可用于提取数据,合并流和创建新流。该语言通过一种操作来增强查询,以实现更复杂的数据转换,例如傅立叶转换。 dQUOB系统已应用于两个大型分布式应用程序:安全关键的自主机器人仿真和用于全球大气传输建模的科学软件可视化。在本文中,我们介绍了dQUOB系统以及为评估其在数据密集型广域计算中的适用性而进行的性能评估结果,在这种情况下,必须相对于连续查询评估的成本来评估便携式数据转换的好处。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号