...
  • 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>Machine translation >Sign boundary and hand articulation feature recognition in Sign Language videos
【24h】

Sign boundary and hand articulation feature recognition in Sign Language videos

机译：标志界限和手动铰接功能识别在手语视频中

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

In this paper we present a recommendation system for (semi-)automatic annotation of sign language videos exploiting deep learning techniques, which handle handshape recognition in continuous signing data. Major tools in our approach have been the keypoint output of OpenPose and the use of HamNoSys in sign annotation of the training data. Prior to application on signed phrases, we tested our method with recognition of hand shape, hand location and palm orientation in isolated signs using two lexical datasets. The system has been trained on the Danish Sign Language lexicon and has also been applied to POLYTROPON, a lexicon of the Greek Sign Language (GSL), for which we received satisfactory recognition results. Experimentation with the POLYTROPON corpus of GSL phrases, has provided results which verify that our approach exhibits satisfactory accuracy rates. Thus, it can be exploited in a recommendation system for semi-automatic annotation of isolated signs and signed phrases in big SL video data, also contributing towards the development of further datasets for machine learning training.
机译：在本文中，我们提出了一种推荐系统（半）自动注释的手语视频利用深度学习技术，该技术处理了连续签名数据中的手形识别。我们的方法中的主要工具一直是调整的关键点输出和使用Hamnosys的签署训练数据的注释。在签名的短语上申请之前，我们通过两个词汇数据集在孤立的标志中识别手工形状，手势和手掌方向的方法。该系统已在丹麦手语遗传培训中培训，也已应用于Gelopon，这是希腊语手语（GSL）的Lexicon，我们接受了令人满意的识别结果。使用GSL短语的聚托管语料库进行实验，提供了验证我们的方法呈现令人满意的精度率的结果。因此，它可以在一个关于分离标志的半自动注释和大型SL视频数据中的签名短语推荐系统中的推荐系统中，也有助于开发用于机器学习训练的其他数据集。

著录项

  • 来源
    《Machine translation》 |2021年第3期|323-343|共21页
  • 作者

    Koulierakis Ioannis; Siolas Georgios; Efthimiou Eleni; Fotinea Stavroula-Evita; Stafylopatis Andreas-Georgios;

  • 作者单位

    ATHENA RC Inst Language & Speech Proc ILSP Dept Embodied Interact & Robot Sign Language Technol Team Artemidos 6 & Epidavrou Maroussi 15125 Greece;

    Natl Tech Univ Athens Sch Elect & Comp Engn Intelligent Syst Lab Zografou Campus 9 Iroon Polytech Str Zografos 15780 Greece;

    ATHENA RC Inst Language & Speech Proc ILSP Dept Embodied Interact & Robot Sign Language Technol Team Artemidos 6 & Epidavrou Maroussi 15125 Greece;

    ATHENA RC Inst Language & Speech Proc ILSP Dept Embodied Interact & Robot Sign Language Technol Team Artemidos 6 & Epidavrou Maroussi 15125 Greece;

    Natl Tech Univ Athens Sch Elect & Comp Engn Intelligent Syst Lab Zografou Campus 9 Iroon Polytech Str Zografos 15780 Greece;

  • 收录信息 美国《工程索引》(EI);
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

    Sign language recognition; Deep learning; Continuous signing; Recommendation system; Annotated SL resources;

    机译：手语识别;深入学习;连续签名;推荐系统;注释的SL资源;

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号