...
首页> 外文期刊>Language, cognition and neuroscience >Visual speech segmentation: using facial cues to locate word boundaries in continuous speech
【24h】

Visual speech segmentation: using facial cues to locate word boundaries in continuous speech

机译:视觉语音分割:使用面部线索在连续语音中定位单词边界

获取原文
获取原文并翻译 | 示例
           

摘要

Speech is typically a multimodal phenomenon, yet few studies have focused on the exclusive contributions of visual cues to language acquisition. To address this gap, we investigated whether visual prosodic information can facilitate speech segmentation. Previous research has demonstrated that language learners can use lexical stress and pitch cues to segment speech and that learners can extract this information from talking faces. Thus, we created an artificial speech stream that contained minimal segmentation cues and paired it with two synchronous facial displays in which visual prosody was either informative or uninformative for identifying word boundaries. Across three familiarisation conditions (audio stream alone, facial streams alone, and paired audiovisual), learning occurred only when the facial displays were informative to word boundaries, suggesting that facial cues can help learners solve the early challenges of language acquisition.
机译:语音通常是一种多峰现象,但很少有研究集中于视觉线索对语言习得的独特贡献。为了解决这一差距,我们调查了视觉韵律信息是否可以促进语音分割。先前的研究表明,语言学习者可以使用词汇重音和音调提示来分割语音,并且学习者可以从说话的面孔中提取这些信息。因此,我们创建了一个人工语音流,其中包含最少的分段提示,并将其与两个同步的面部显示配对,其中,视觉韵律对于识别单词边界是有益的还是不有益的。在三种熟悉情况下(单独的音频流,单独的面部流和配对的视听),仅当面部显示对单词边界有信息时才进行学习,这表明面部提示可以帮助学习者解决语言习得的早期挑战。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号