首页> 外文期刊>The Journal of the Acoustical Society of America >Contributions of temporal encodings of voicing, voicelessness, fundamental frequency, and amplitude variation to audio-visual and auditory speech perception.
【24h】

Contributions of temporal encodings of voicing, voicelessness, fundamental frequency, and amplitude variation to audio-visual and auditory speech perception.

机译:语音,清音,基频和幅度变化的时间编码对视听和听觉语音感知的贡献。

获取原文
获取原文并翻译 | 示例
           

摘要

Auditory and audio-visual speech perception was investigated using auditory signals of invariant spectral envelope that temporally encoded the presence of voiced and voiceless excitation, variations in amplitude envelope and F0. In experiment 1, the contribution of the timing of voicing was compared in consonant identification to the additional effects of variations in F0 and the amplitude of voiced speech. In audio-visual conditions only, amplitude variation slightly increased accuracy globally and for manner features. F0 variation slightly increased overall accuracy and manner perception in auditory and audio-visual conditions. Experiment 2 examined consonant information derived from the presence and amplitude variation of voiceless speech in addition to that from voicing, F0, and voiced speech amplitude. Binary indication of voiceless excitation improved accuracy overall and for voicing and manner. The amplitude variation of voiceless speech produced only a small increment in place of articulation scores. A final experiment examined audio-visual sentence perception using encodings of voiceless excitation and amplitude variation added to a signal representing voicing and F0. There was a contribution of amplitude variation to sentence perception, but not of voiceless excitation. The timing of voiced and voiceless excitation appears to be the major temporal cues to consonant identity.
机译:使用不变频谱包络的​​听觉信号对听觉和视听语音感知进行了研究,该频谱包络在时间上编码有声和无声激励的存在,幅度包络和F0的变化。在实验1中,将发声时间的贡献在辅音识别中与F0变化和浊音幅度的附加影响进行了比较。仅在视听条件下,幅度变化总体上和方式方面会略微提高准确性。 F0变化在听觉和视听条件下略微提高了总体准确性和方式感知。实验2检验了辅音信息,该辅音信息是从无声语音的存在和幅度变化以及语音,F0和有声语音幅度得到的。无声激励的二进制指示在总体上以及在发声和方式方面提高了准确性。无声语音的幅度变化仅产生了很小的增量,而不是清晰度分数。最终实验使用无声激励和幅度变化编码添加到表示声音和F0的信号上,检查了视听句子的感知能力。幅度变化对句子感知有贡献,但对无声激励没有贡献。有声和无声激发的时间似乎是辅音识别的主要时间线索。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号