• 主题
高级搜索  >
历史搜索 清空历史
首页> 美国卫生研究院文献>The Journal of Neuroscience >Credit Assignment in a Motor Decision Making Task Is Influenced by Agency and Not Sensory Prediction Errors
【2h】

Credit Assignment in a Motor Decision Making Task Is Influenced by Agency and Not Sensory Prediction Errors

机译：运动决策任务中的信用分配受代理机构的影响而不是感官预测错误的影响

代理获取
本网站仅为用户提供外文OA文献查询和代理获取服务，本网站没有原文。下单后我们将采用程序或人工为您竭诚获取高质量的原文，但由于OA文献来源多样且变更频繁，仍可能出现获取不到、文献不完整或与标题不符等情况，如果获取不到我们将提供退款服务。请知悉。
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Failures to obtain reward can occur from errors in action selection or action execution. Recently, we observed marked differences in choice behavior when the failure to obtain a reward was attributed to errors in action execution compared with errors in action selection (). Specifically, participants appeared to solve this credit assignment problem by discounting outcomes in which the absence of reward was attributed to errors in action execution. Building on recent evidence indicating relatively direct communication between the cerebellum and basal ganglia, we hypothesized that cerebellar-dependent sensory prediction errors (SPEs), a signal indicating execution failure, could attenuate value updating within a basal ganglia-dependent reinforcement learning system. Here we compared the SPE hypothesis to an alternative, “top-down” hypothesis in which changes in choice behavior reflect participants' sense of agency. In two experiments with male and female human participants, we manipulated the strength of SPEs, along with the participants' sense of agency in the second experiment. The results showed that, whereas the strength of SPE had no effect on choice behavior, participants were much more likely to discount the absence of rewards under conditions in which they believed the reward outcome depended on their ability to produce accurate movements. These results provide strong evidence that SPEs do not directly influence reinforcement learning. Instead, a participant's sense of agency appears to play a significant role in modulating choice behavior when unexpected outcomes can arise from errors in action execution.>SIGNIFICANCE STATEMENT When learning from the outcome of actions, the brain faces a credit assignment problem: Failures of reward can be attributed to poor choice selection or poor action execution. Here, we test a specific hypothesis that execution errors are implicitly signaled by cerebellar-based sensory prediction errors. We evaluate this hypothesis and compare it with a more “top-down” hypothesis in which the modulation of choice behavior from execution errors reflects participants' sense of agency. We find that sensory prediction errors have no significant effect on reinforcement learning. Instead, instructions influencing participants' belief of causal outcomes appear to be the main factor influencing their choice behavior.
机译：动作选择或动作执行中的错误可能导致无法获得奖励。最近，我们观察到，选择行为的错误与行动选择的错误相比，是因为行动执行的错误导致无法获得奖励。具体而言，参与者似乎通过打折结果来解决此信用分配问题，在这种结果中，由于行动执行中的错误而导致缺乏奖励。基于最近的证据表明小脑与基底神经节之间的相对直接交流，我们假设小脑依赖的感觉预测错误（SPE）是一种指示执行失败的信号，可以削弱基底神经依赖的强化学习系统中的值更新。在这里，我们将SPE假设与另一种“自上而下”的假设进行了比较，其中选择行为的变化反映了参与者的代理意识。在男女参与的两个实验中，我们在第二个实验中操纵了SPE的强度以及参与者的代理意识。结果表明，尽管SPE的强度对选择行为没有影响，但参与者在认为奖励的结果取决于他们产生准确动作的能力的情况下，更可能不重视奖励的缺失。这些结果提供了有力的证据，表明SPE不会直接影响强化学习。相反，当动作执行中的错误可能导致意外结果时，参与者的代理意识似乎在调节选择行为中起着重要作用。>意义声明当从动作结果中学习时，大脑会面临信誉分配问题：奖励失败可归因于选择选择不当或行动执行不力。在这里，我们测试一个特定的假设，即执行错误是由基于小脑的感觉预测错误暗示的。我们评估该假设，并将其与更“自上而下”的假设进行比较，在该假设中，执行错误对选择行为的调节反映了参与者的代理意识。我们发现感觉预测错误对强化学习没有显着影响。相反，影响参与者对因果结果的信念的指令似乎是影响其选择行为的主要因素。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
代理获取

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号