...
  • 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>The European Journal of Neuroscience >Model-based learning and the contribution of the orbitofrontal cortex to the model-free world
【24h】

Model-based learning and the contribution of the orbitofrontal cortex to the model-free world

机译：基于模型的学习以及眶额皮质对无模型世界的贡献

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Learning is proposed to occur when there is a discrepancy between reward prediction and reward receipt. At least two separate systems are thought to exist: one in which predictions are proposed to be based on model-free or cached values; and another in which predictions are model-based. A basic neural circuit for model-free reinforcement learning has already been described. In the model-free circuit the ventral striatum (VS) is thought to supply a common-currency reward prediction to midbrain dopamine neurons that compute prediction errors and drive learning. In a model-based system, predictions can include more information about an expected reward, such as its sensory attributes or current, unique value. This detailed prediction allows for both behavioral flexibility and learning driven by changes in sensory features of rewards alone. Recent evidence from animal learning and human imaging suggests that, in addition to model-free information, the VS also signals model-based information. Further, there is evidence that the orbitofrontal cortex (OFC) signals model-based information. Here we review these data and suggest that the OFC provides model-based information to this traditional model-free circuitry and offer possibilities as to how this interaction might occur.
机译：建议在奖励预测与奖励收入之间存在差异时进行学习。至少存在两个独立的系统：一个基于非模型值或缓存值的预测建议;另一个预测是基于模型的。已经描述了用于无模型强化学习的基本神经回路。在无模型电路中，腹侧纹状体（VS）被认为可以为计算预测误差并驱动学习的中脑多巴胺神经元提供一种通用货币奖励预测。在基于模型的系统中，预测可以包括有关预期奖励的更多信息，例如其感官属性或当前的唯一值。这种详细的预测既允许行为灵活性，又可以通过奖励的感官特征变化来驱动学习。来自动物学习和人类成像的最新证据表明，除了无模型信息外，VS还向基于模型的信息发出信号。此外，有证据表明眶额叶皮质（OFC）发出基于模型的信息。在这里，我们回顾这些数据，并建议OFC为这种传统的无模型电路提供基于模型的信息，并提供有关这种相互作用如何发生的可能性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号