• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>IEEE transactions on industrial informatics >Towards Improving Social Communication Skills With Multimodal Sensory Information
【24h】

Towards Improving Social Communication Skills With Multimodal Sensory Information

机译：通过多模态感官信息提高社交沟通能力

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

How to improve social communication skills for children, especially those with social communication difficulties such as attention deficit/hyperactivity disorder, has long been a challenge faced by researchers and therapists. Recent research indicates that computer-assisted approaches may be effective in addressing this issue. This study aimed to understand children's behaviors and then provide appropriate support to improve their social communication skills. We have established an intelligent system, inside which a child can freely play interactive social skills games with virtual characters. The virtual characters can adjust their own behaviors by adapting to the child's cognitive state (e.g., focus of attention) and affective state (e.g., happiness or surprise). The child's behavior is identified in real-time by recognition of multimodal sensory information, which includes head pose and eye gaze estimation, gesture detection, and affective state detection supported by a series of algorithms proposed in this study. Furthermore, this intelligent system has been enabled in a nonintrusive manner using a novel approach of multicamera surveillance to provide the child with natural interaction with the system. Experimental results show the system can estimate a user's attention and affective states with correctness rates of 93% and 91.3%, respectively. The results obtained suggest that the methods have strong potential as alternative methods for sensing human behavior and providing appropriate support.
机译：长期以来，如何提高儿童的社交能力，特别是那些社交沟通困难的儿童，例如注意力不足/多动症，一直是研究人员和治疗师面临的挑战。最近的研究表明，计算机辅助方法可能可以有效解决这一问题。这项研究旨在了解儿童的行为，然后提供适当的支持以提高他们的社交能力。我们已经建立了一个智能系统，在这个系统中，孩子可以自由玩虚拟人物的互动社交技能游戏。虚拟角色可以通过适应孩子的认知状态（例如注意力集中）和情感状态（例如幸福或惊喜）来调整自己的行为。通过多模式感官信息的识别，可以实时识别孩子的行为，该信息包括头部姿势和眼睛注视估计，手势检测以及本研究提出的一系列算法支持的情感状态检测。此外，已经使用多摄像机监视的新颖方法以非侵入方式启用了该智能系统，以为孩子提供与系统的自然互动。实验结果表明，该系统可以正确估计用户的注意力和情感状态，正确率分别为93％和91.3％。获得的结果表明，这些方法作为感知人类行为和提供适当支持的替代方法具有强大的潜力。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号