...
首页> 外文期刊>Automatic Control, IEEE Transactions on >Stochastic Dual Averaging for Decentralized Online Optimization on Time-Varying Communication Graphs
【24h】

Stochastic Dual Averaging for Decentralized Online Optimization on Time-Varying Communication Graphs

机译:时变通信图的分散在线优化的随机对偶平均

获取原文
获取原文并翻译 | 示例
           

摘要

We consider a decentralized online convex optimization problem in a network of agents, where each agent controls only a coordinate (or a part) of the global decision vector. For such a problem, we propose two decentralized stochastic variants (SODA-C and SODA-PS) of Nesterov's dual averaging method (DA), where each agent only uses a coordinate of the noise-corrupted gradient in the dual-averaging step. We show that the expected regret bounds for both algorithms have sublinear growth of O(√T), with the time horizon T, in scenarios when the underlying communication topology is time-varying. The sublinear regret can be obtained when the stepsize is of the form 1/√t and the objective functions are Lipschitz-continuous convex functions with Lipschitz gradients, and the variance of the noisy gradients is bounded. We also provide simulation results of the proposed algorithms on sensor networks to complement our theoretical analysis.
机译:我们考虑了代理商网络中的分散在线凸优化问题,其中每个代理商仅控制全局决策向量的坐标(或一部分)。对于这样的问题,我们提出了Nesterov双重平均方法(DA)的两个分散的随机变体(SODA-C和SODA-PS),其中每个代理在双重平均步骤中仅使用受噪声破坏梯度的坐标。我们显示,在基础通信拓扑随时间变化的情况下,两种算法的预期后悔界限均具有O(√T)的亚线性增长,且具有时间范围T。当步长大小为1 /√t且目标函数是具有Lipschitz梯度的Lipschitz-连续凸函数,并且有噪梯度的方差有界时,可以获得次线性遗憾。我们还提供了在传感器网络上提出的算法的仿真结果,以补充我们的理论分析。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号