首页> 外国专利> Neural network model for reaching a goal state

Neural network model for reaching a goal state

机译:达到目标状态的神经网络模型

摘要

An object, such as a robot, is located at an initial state in a finite state space area and moves under the control of the unsupervised neural network model of the invention. The network instructs the object to move in one of several directions from the initial state. Upon reaching another state, the model again instructs the object to move in one of several directions. These instructions continue until either: a) the object has completed a cycle by ending up back at a state it has been to previously during this cycle, or b) the object has completed a cycle by reaching the goal state. Upon reaching a state, the neural network model calculates a level of satisfaction with its progress towards reaching the goal state. If the level of satisfaction is low, the neural network model is more likely to override what has been learned thus far and deviate from a path known to lead to the goal state to experiment with new and possibly better paths. If the level of satisfaction is high, the neural network model is much less likely to experiment with new paths. The object is guaranteed to eventually find the best path to the goal state from any starting location, assuming that the level of satisfaction does not exceed a threshold point where learning ceases.
机译:诸如机器人之类的物体位于有限状态空间区域中的初始状态,并在本发明的非监督神经网络模型的控制下移动。网络指示对象从初始状态向几个方向之一移动。到达另一状态后,模型再次指示对象沿多个方向之一移动。这些指令一直持续到:a)对象通过回到该周期之前的状态而完成一个周期,或者b)对象通过达到目标状态而完成了一个周期。达到状态后,神经网络模型会计算其达到目标状态的进度的满意度。如果满意度较低,则神经网络模型更有可能超越到目前为止所学的知识,并偏离已知的导致目标状态尝试新的且可能更好的路径的路径。如果满意度很高,则神经网络模型尝试新路径的可能性将大大降低。假设满足水平不超过学习停止的阈值点,则可以保证该对象最终从任何起始位置找到通往目标状态的最佳路径。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号