首页> 外文学位 >Fusion of depth and inertial sensing for human action recognition.
【24h】

Fusion of depth and inertial sensing for human action recognition.

机译:深度和惯性感应的融合,可用于人类动作识别。

获取原文
获取原文并翻译 | 示例

摘要

Human action recognition is an active research area benefitting many applications. Example applications include human-computer interaction, assistive-living, rehabilitation, and gaming. Action recognition can be broadly categorized into vision-based and inertial sensor-based. Under realistic operating conditions, it is well known that there are recognition rate limitations when using a single modality sensor due to the fact that no single sensor modality can cope with various situations that occur in practice. The hypothesis addressed in this dissertation is that by using and fusing the information from two differing modality sensors that provide 3D data (a Microsoft Kinect depth camera and a wearable inertial sensor), a more robust human action recognition is achievable. More specifically, effective and computationally efficient features have been devised and extracted from depth images. Both feature-level fusion and decision-level fusion approaches have been investigated for a dual-modality sensing incorporating a depth camera and an inertial sensor. Experimental results obtained indicate that the developed fusion approaches generate higher recognition rates compared to the situations when an individual sensor is used. Moreover, an actual working action recognition system using depth and inertial sensing has been devised which runs in real-time on laptop platforms. In addition, the developed fusion framework has been applied to a medical application.
机译:人体动作识别是一个活跃的研究领域,受益于许多应用。示例应用程序包括人机交互,辅助生活,康复和游戏。动作识别可以大致分为基于视觉的和基于惯性传感器的。在现实的操作条件下,众所周知的是,使用单个模式传感器时存在识别率限制,这是因为没有一个传感器模式可以应对实际情况。本文提出的假设是,通过使用和融合来自提供3D数据的两个不同模态传感器(Microsoft Kinect深度相机和可穿戴惯性传感器)的信息,可以实现更强大的人类动作识别。更具体地说,已经设计出有效的和计算上有效的特征并从深度图像中提取出这些特征。对于结合深度相机和惯性传感器的双模态传感,已经研究了特征级融合和决策级融合方法。获得的实验结果表明,与使用单个传感器的情况相比,开发的融合方法可产生更高的识别率。此外,已经设计了使用深度和惯性感测的实际工作动作识别系统,该系统在笔记本电脑平台上实时运行。此外,已开发的融合框架已应用于医疗应用。

著录项

  • 作者

    Chen, Chen.;

  • 作者单位

    The University of Texas at Dallas.;

  • 授予单位 The University of Texas at Dallas.;
  • 学科 Electrical engineering.
  • 学位 Ph.D.
  • 年度 2016
  • 页码 147 p.
  • 总页数 147
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类 康复医学;
  • 关键词

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号