...
首页> 外文期刊>neuroscience of consciousness >Confidence modulates exploration and exploitation in value-based learning
【24h】

Confidence modulates exploration and exploitation in value-based learning

机译:信心调节基于价值的学习中的探索和利用

获取原文
获取原文并翻译 | 示例
           

摘要

Uncertainty is ubiquitous in cognitive processing. In this study, we aim to investigate the ability agents possess to track and report the noise inherent in their mental operations, often in the form of confidence judgments. Here, we argue that humans can use uncertainty inherent in their representations of value beliefs to arbitrate between exploration and exploitation. Such uncertainty is reflected in explicit confidence judgments. Using a novel variant of a multi-armed bandit paradigm, we studied how beliefs were formed and how uncertainty in the encoding of these value beliefs (belief confidence) evolved over time. We found that people used uncertainty to arbitrate between exploration and exploitation, reflected in a higher tendency toward exploration when their confidence in their value representations was low. We furthermore found that value uncertainty can be linked to frameworks of metacognition in decision making in two ways. First, belief confidence drives decision confidence, i.e. people's evaluation of their own choices. Second, individuals with higher metacognitive insight into their choices were also better at tracing the uncertainty in their environment. Together, these findings argue that such uncertainty representations play a key role in the context of cognitive control.
机译:不确定性在认知过程中无处不在。在这项研究中,我们旨在调查智能体拥有跟踪和报告其心理操作中固有的噪音的能力,通常以置信判断的形式出现。在这里,我们认为人类可以利用其价值信念表述中固有的不确定性来在探索和开发之间进行仲裁。这种不确定性反映在明确的置信度判断中。使用多臂强盗范式的新变体,我们研究了信念是如何形成的,以及这些价值信念(信念信心)编码的不确定性如何随着时间的推移而演变。我们发现,人们利用不确定性在勘探和开发之间进行仲裁,这反映在当他们对自己的价值表示的信心较低时,他们更倾向于探索。我们进一步发现,价值不确定性可以通过两种方式与决策中的元认知框架联系起来。首先,信念信心驱动决策信心,即人们对自己选择的评估。其次,对自己的选择具有更高元认知洞察力的个体也更善于追踪环境中的不确定性。总之,这些发现表明,这种不确定性表征在认知控制的背景下起着关键作用。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号