首页> 外文期刊>Statistics and computing >Langevin incremental mixture importance sampling
【24h】

Langevin incremental mixture importance sampling

机译:Langevin增量混合物重要性抽样

获取原文
获取原文并翻译 | 示例
           

摘要

This work proposes a novel method through which local information about the target density can be used to construct an efficient importance sampler. The backbone of the proposed method is the incremental mixture importance sampling (IMIS) algorithm of Raftery and Bao (Biometrics 66(4):1162-1173, 2010), which builds a mixture importance distribution incrementally, by positioning new mixture components where the importance density lacks mass, relative to the target. The key innovation proposed here is to construct the mean vectors and covariance matrices of the mixture components by numerically solving certain differential equations, whose solution depends on the local shape of the target log-density. The new sampler has a number of advantages: (a) it provides an extremely parsimonious parametrization of the mixture importance density, whose configuration effectively depends only on the shape of the target and on a single free parameter representing pseudo-time; (b) it scales well with the dimensionality of the target; (c) it can deal with targets that are not log-concave. The performance of the proposed approach is demonstrated on two synthetic non-Gaussian densities, one being defined on up to eighty dimensions, and on a Bayesian logistic regression model, using the Sonar dataset. The Julia code implementing the importance sampler proposed here can be found at https://github.com/mfasiolo/LIMIS.
机译:这项工作提出了一种新颖的方法,通过该方法,可以使用有关目标密度的局部信息来构建有效的重要性采样器。提出的方法的主干是Raftery和Bao的增量混合重要性抽样(IMIS)算法(Biometrics 66(4):1162-1173,2010),该算法通过将新的混合成分放在重要位置来逐步建立混合重要性分布相对于目标,密度缺乏质量。这里提出的关键创新是通过数值求解某些微分方程来构造混合成分的均值矢量和协方差矩阵,这些微分方程的解取决于目标对数密度的局部形状。新的采样器具有许多优点:(a)它提供了混合物重要性密度的极其简约的参数化,其配置实际上仅取决于目标的形状和代表伪时间的单个自由参数; (b)与目标的尺寸很好地匹配; (c)它可以处理非凹形的目标。使用Sonar数据集,在两种合成的非高斯密度上定义了该方法的性能,一种在多达80个维度上定义,另一种在贝叶斯逻辑回归模型上进行了证明。可在https://github.com/mfasiolo/LIMIS上找到实现此处建议的重要性采样器的Julia代码。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号