首页> 外国专利> System for multiresolution analysis assisted reinforcement learning approach to run-by-run control

System for multiresolution analysis assisted reinforcement learning approach to run-by-run control

机译:多分辨率分析辅助强化学习的逐行控制方法

摘要

A new multiresolution analysis (wavelet) assisted reinforcement learning (RL) based control strategy that can effectively deal with both multiscale disturbances in processes and the lack of process models. The application of wavelet aided RL based controller represents a paradigm shift in the control of large scale stochastic dynamic systems of which the control problem is a subset. The control strategy is termed a WRL-RbR controller. The WRL-RbR controller is tested on a multiple-input-multiple-output (MIMO) Chemical Mechanical Planarization (CMP) process of wafer fabrication for which process model is available. Results show that the RL controller outperforms EWMA based controllers for low autocorrelation. The new controller also performs quite well for strongly autocorrelated processes for which the EWMA controllers are known to fail. Convergence analysis of the new breed of WRL-RbR controller is presented. Further enhancement of the controller to deal with model free processes and for inputs coming from spatially distributed environments are also addressed.
机译:一种新的多分辨率分析(小波)辅助基于强化学习(RL)的控制策略,可以有效地处理过程中的多尺度干扰和过程模型的缺乏。基于小波辅助RL的控制器的应用代表了控制问题为子集的大规模随机动态系统的控制范式转变。该控制策略称为WRL-RbR控制器。 WRL-RbR控制器在晶圆制造的多输入多输出(MIMO)化学机械平面化(CMP)工艺上进行了测试,该工艺模型可用。结果表明,对于低自相关,RL控制器优于基于EWMA的控制器。对于已知的EWMA控制器发生故障的高度自相关的过程,新的控制器也表现出色。介绍了新型WRL-RbR控制器的收敛性分析。还解决了控制器的进一步增强,以处理无模型的过程以及来自空间分布环境的输入。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号