首页> 外文会议>Proceedings of the EuroSys 2012 conference >Kineograph: Taking the Pulse of a Fast-Changing and Connected World
【24h】

Kineograph: Taking the Pulse of a Fast-Changing and Connected World

机译:放映机:把握瞬息万变的世界

获取原文
获取原文并翻译 | 示例

摘要

Kineograph is a distributed system that takes a stream of incoming data to construct a continuously changing graph, which captures the relationships that exist in the data feed. As a computing platform, Kineograph further supports graph-mining algorithms to extract timely insights from the fast-changing graph structure. To accommodate graph-mining algorithms that assume a static underlying graph, Kineograph creates a series of consistent snapshots, using a novel and efficient epoch commit protocol. To keep up with continuous updates on the graph, Kineograph includes an incremental graph-computation engine. We have developed three applications on top of Kineograph to analyze Twitter data: user ranking, approximate shortest paths, and contro-versial topic detection. For these applications. Kineograph takes a live Twitter data feed and maintains a graph of edges between all users and hashtags. Our evaluation shows that with 40 machines processing 100K tweets per second, Ki-neograph is able to continuously compute global properties, such as user ranks, with less than 2.5-minute timeliness guar-antees. This rate of traffic is more than 10 times the reported peak rate of Twitter as of October 2011.
机译:Kineograph是一个分布式系统,它采用传入数据流来构造一个连续变化的图形,该图形捕获数据馈送中存在的关系。作为一个计算平台,Kineograph进一步支持图挖掘算法,以从快速变化的图结构中及时提取见解。为了适应假设静态基础图的图挖掘算法,Kineograph使用新颖有效的纪元提交协议创建了一系列一致的快照。为了跟上图形的不断更新,Kineograph包括一个增量图形计算引擎。我们已经在Kineograph的基础上开发了三个应用程序来分析Twitter数据:用户排名,近似最短路径和有争议的主题检测。对于这些应用。 Kineograph接收实时Twitter数据提要,并维护所有用户和主题标签之间的边缘图。我们的评估表明,借助40台每秒处理10万条推文的机器,Ki-neograph能够以不到2.5分钟的及时性瓜尔-antees连续计算全局属性,例如用户等级。截至2011年10月,此流量的速度是Twitter峰值流量的10倍以上。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号