...
首页> 外文期刊>The quarterly journal of experimental psychology: QJEP >Audiovisual speech from emotionally expressive and lateralized faces
【24h】

Audiovisual speech from emotionally expressive and lateralized faces

机译:来自情感表达和偏侧面孔的视听语音

获取原文
获取原文并翻译 | 示例
           

摘要

Emotional expression and how it is lateralized across the two sides of the face may influence how we detect audiovisual speech. To investigate how these components interact we conducted experiments comparing the perception of sentences expressed with happy, sad, and neutral emotions. In addition we isolated the facial asymmetries for affective and speech processing by independently testing the two sides of a talker's face. These asymmetrical differences were exaggerated using dynamic facial chimeras in which left- or right-face halves were paired with their mirror image during speech production. Results suggest that there are facial asymmetries in audiovisual speech such that the right side of the face and right-facial chimeras supported better speech perception than their left-face counterparts. Affective information was also found to be critical in that happy expressions tended to improve speech performance on both sides of the face relative to all other emotions, whereas sad emotions generally inhibited visual speech information, particularly from the left side of the face. The results suggest that approach information may facilitate visual and auditory speech detection.
机译:情感表达以及如何在面部的两侧偏斜,可能会影响我们检测视听语音的方式。为了研究这些成分如何相互作用,我们进行了实验,比较了用快乐,悲伤和中性情绪表达的句子的感知能力。此外,我们通过独立测试说话者面部的两侧来隔离情感和语音处理的面部不对称性。使用动态面部嵌合体会夸大这些不对称差异,其中在语音生成过程中,左半部分或右半部分与其镜像配对。结果表明,视听语音中存在面部不对称性,因此,面部右侧和右侧面部嵌合体比左侧左侧具有更好的语音感知能力。还发现情感信息是至关重要的,因为相对于所有其他情感,快乐的表情倾向于改善面部两侧的语音表现,而悲伤的情感通常会抑制视觉语音信息,尤其是从面部左侧。结果表明,进场信息可以促进视觉和听觉语音检测。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号