首页> 外文期刊>Statistics and computing >Stochastic variational inference for large-scale discrete choice models using adaptive batch sizes
【24h】

Stochastic variational inference for large-scale discrete choice models using adaptive batch sizes

机译:使用自适应批大小的大规模离散选择模型的随机变分推断

获取原文
获取原文并翻译 | 示例
           

摘要

Discrete choice models describe the choices made by decision makers among alternatives and play an important role in transportation planning, marketing research and other applications. The mixed multinomial logit (MMNL) model is a popular discrete choice model that captures heterogeneity in the preferences of decision makers through random coefficients. While Markov chain Monte Carlo methods provide the Bayesian analogue to classical procedures for estimating MMNL models, computations can be prohibitively expensive for large datasets. Approximate inference can be obtained using variational methods at a lower computational cost with competitive accuracy. In this paper, we develop variational methods for estimating MMNL models that allow random coefficients to be correlated in the posterior and can be extended easily to large-scale datasets. We explore three alternatives: (1) Laplace variational inference, (2) nonconjugate variational message passing and (3) stochastic linear regression. Their performances are compared using real and simulated data. To accelerate convergence for large datasets, we develop stochastic variational inference for MMNL models using each of the above alternatives. Stochastic variational inference allows data to be processed in minibatches by optimizing global variational parameters using stochastic gradient approximation. A novel strategy for increasing minibatch sizes adaptively within stochastic variational inference is proposed.
机译:离散选择模型描述了决策者在替代方案中做出的选择,并在运输计划,市场研究和其他应用中发挥着重要作用。混合多项式对数(MMNL)模型是一种流行的离散选择模型,该模型通过随机系数捕获决策者偏好中的异质性。尽管马尔可夫链蒙特卡罗方法提供了经典过程的贝叶斯类似物来估计MMNL模型,但是对于大型数据集,计算可能会非常昂贵。可以使用变分方法以较低的计算成本获得具有竞争准确性的近似推断。在本文中,我们开发了用于估计MMNL模型的变分方法,该方法允许随机系数在后面进行关联,并且可以轻松地扩展到大规模数据集。我们探索了三种选择:(1)拉普拉斯变分推理,(2)非共轭变分消息传递和(3)随机线性回归。使用真实和模拟数据比较它们的性能。为了加快大型数据集的收敛速度,我们使用上述每种替代方法为MMNL模型开发了随机变分推理。随机变分推论允许通过使用随机梯度近似优化全局变分参数,以小批量处理数据。提出了一种在随机变分推理中自适应增加小批量大小的新策略。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号