首页> 外文期刊>Parallel and Distributed Systems, IEEE Transactions on >Discovering Statistical Models of Availability in Large Distributed Systems: An Empirical Study of SETI@home
【24h】

Discovering Statistical Models of Availability in Large Distributed Systems: An Empirical Study of SETI@home

机译:发现大型分布式系统中可用性的统计模型:SETI @ home的经验研究

获取原文
获取原文并翻译 | 示例
           

摘要

In the age of cloud, Grid, P2P, and volunteer distributed computing, large-scale systems with tens of thousands of unreliable hosts are increasingly common. Invariably, these systems are composed of heterogeneous hosts whose individual availability often exhibit different statistical properties (for example stationary versus nonstationary behavior) and fit different models (for example exponential, Weibull, or Pareto probability distributions). In this paper, we describe an effective method for discovering subsets of hosts whose availability have similar statistical properties and can be modeled with similar probability distributions. We apply this method with about 230,000 host availability traces obtained from a real Internet-distributed system, namely SETI@home. We find that about 21 percent of hosts exhibit availability, that is, a truly random process, and that these hosts can often be modeled accurately with a few distinct distributions from different families. We show that our models are useful and accurate in the context of a scheduling problem that deals with resource brokering. We believe that these methods and models are critical for the design of stochastic scheduling algorithms across large systems where host availability is uncertain.
机译:在云,网格,P2P和志愿者分布式计算的时代,带有成千上万个不可靠主机的大规模系统变得越来越普遍。这些系统总是由异构主机组成,这些主机的个体可用性通常表现出不同的统计属性(例如平稳与非平稳行为)并适合不同的模型(例如指数,Weibull或Pareto概率分布)。在本文中,我们描述了一种发现主机可用性子集的有效方法,这些子集的可用性具有相似的统计属性,并且可以用相似的概率分布进行建模。我们将此方法与从真实的Internet分布式系统SETI @ home获得的大约230,000主机可用性跟踪一起应用。我们发现大约21%的主机具有可用性,也就是说,这是一个真正的随机过程,并且这些主机通常可以使用来自不同家族的一些不同分布进行精确建模。我们表明,在涉及资源代理的调度问题中,我们的模型是有用且准确的。我们认为,这些方法和模型对于跨大型系统(不确定主机可用性)的随机调度算法的设计至关重要。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号