首页> 外文期刊>IEEE Signal Processing Magazine >A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning: Principals, Recent Advances, and Applications
【24h】

A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learning: Principals, Recent Advances, and Applications

机译:信号处理和机器学习中的零顺序优化引物:校长,最近的进步和应用

获取原文
获取原文并翻译 | 示例
           

摘要

Zeroth-order (ZO) optimization is a subset of gradient-free optimization that emerges in many signal processing and machine learning (ML) applications. It is used for solving optimization problems similarly to gradient-based methods. However, it does not require the gradient, using only function evaluations. Specifically, ZO optimization iteratively performs three major steps: gradient estimation, descent direction computation, and the solution update. In this article, we provide a comprehensive review of ZO optimization, with an emphasis on showing the underlying intuition, optimization principles, and recent advances in convergence analysis. Moreover, we demonstrate promising applications of ZO optimization, such as evaluating robustness and generating explanations from black-box deep learning (DL) models and efficient online sensor management.
机译:零顺序(ZO)优化是一种渐变优化的子集,其在许多信号处理和机器学习(ML)应用中出现。它用于解决与基于梯度的方法类似的优化问题。但是,它不需要仅使用函数评估。具体地,ZO优化迭代地执行三个主要步骤:梯度估计,下降方向计算和解决方案更新。在本文中,我们对ZO优化进行了全面审查,重点是展示潜在的直觉,优化原则和收敛分析的最新进展。此外,我们展示了ZO优化的有希望的应用,例如评估来自黑盒深度学习(DL)模型和高效在线传感器管理的鲁棒性和生成解释。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号