【24h】

Analysis of visual speech signatures

机译:视觉语音签名分析

获取原文
获取原文并翻译 | 示例

摘要

The visual components of speech are the subject of research in resent years. The motivation of this paper is to suggest the concept of signature for visualized speech. These visual signatures are defined for basic components of mouth movement corresponding to sound units. Therefore, an accurate and unified database for perception and generation of visual speech could be organized. Toward this aim, mathematical tools and processes are suggested for concluding the speech related visual units. The lip geometry is parameterized with feature points. The main interpolation tool has been chosen as the Barycentric Lagrange interpolation (BLI). It can include the mouth geometry's structure dynamically during articulation in mathematical form. The outcomes (experimental models) of proposed approach associate mathematical expressions. Such method could be successor of lip tracking and identification algorithm in both lip reading and visual speech animation systems.
机译:语音的视觉成分是近年来研究的主题。本文的目的是提出可视化语音签名的概念。这些视觉特征是针对与声音单位相对应的嘴巴运动的基本成分而定义的。因此,可以组织用于视觉语音的感知和生成的准确且统一的数据库。为了达到这个目的,建议使用数学工具和过程来结束与语音相关的视觉单元。使用特征点对唇形进行参数化。主要的插值工具已被选为重心拉格朗日插值(BLI)。它可以以数学形式在咬合过程中动态地包括口腔几何结构。拟议方法的结果(实验模型)与数学表达式相关联。这种方法可以是唇读和视觉语音动画系统中的唇跟踪和识别算法的后继者。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号