首页> 外文会议>IEEE International Conference on Biomedical Robotics and Biomechatronics >Exploiting the importance of vowelized sounds in speech comprehension: An application for assisting speechless people
【24h】

Exploiting the importance of vowelized sounds in speech comprehension: An application for assisting speechless people

机译:利用语音理解中的修饰声音的重要性:协助无言无言的人

获取原文

摘要

This paper proposes a solution that can be used to develop an assistive device to help people that have tracheostomies to make use of verbal communication. Based on the analysis of video images, we propose to develop a system suitable to be used to produce vowel sounds. Exploring the McGurk effect, we expect seeing the mouth movements and listening to the corresponding vowels to be sufficient for improving the understanding of “speechless people”. We conducted three experiments which results show that: 1) just adding vowels' sounds can improve the understandability of the lip reading process; 2) it is possible to detect and to classify vowel-related mouth movements; 3) people can adapt mouth movements to make the system generate the intended vowel, even when it was initially adapted to another person.
机译:本文提出了一种解决方案,可用于开发辅助装置,帮助患有气管造称的人们利用口头沟通。基于视频图像的分析,我们建议开发适合用于生产元音声音的系统。探索McGurk效果,我们期望看到嘴巴运动并听取相应的元音,足以改善对“无言之的人”的理解。我们进行了三个实验,结果表明:1)只是添加元音的声音可以提高唇读过程的可理解性; 2)可以检测和分类与元音相关的嘴巴运动; 3)人们可以适应口动运动使系统产生预期元音,即使它最初适应另一个人。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号