首页> 外国专利> WEARABLE AUGMENTED REALITY DEVICE THAT INPUTS MOUSE EVENTS USING HAND GESTURE AND METHOD OF MOUSE EVENT INPUT FOR WEARABLE AUGMENTED REALITY DEVICE USING HAND GESTURE

WEARABLE AUGMENTED REALITY DEVICE THAT INPUTS MOUSE EVENTS USING HAND GESTURE AND METHOD OF MOUSE EVENT INPUT FOR WEARABLE AUGMENTED REALITY DEVICE USING HAND GESTURE

机译:可穿戴增强现实设备,使用手势使用手势和鼠标事件输入的方法输入鼠标事件,用于使用手势的可穿戴的增强现实设备

摘要

The present invention relates to a wearable augmented reality device for inputting a mouse event using a hand gesture, and more particularly, to a wearable augmented reality device, comprising: a setting unit for setting a hand gesture event and a mouse event to correspond to each other; a joint acquisition unit for acquiring joint coordinates of a user's hand from an image taken by the wearable augmented reality device; a hand motion detection unit for detecting a hand motion defined by a hand position and a hand shape using the joint coordinates obtained by the joint obtaining unit; an event detection unit that detects a change in the hand gesture as a hand gesture event by using the hand gesture detected in the image; and a control unit that extracts a mouse event corresponding to the detected hand motion event according to the setting of the setting unit, controls the wearable augmented reality device according to the extracted mouse event, and implements a mouse function using hand motion, The hand motion event is characterized in that it is defined as a change over a predetermined time of a hand motion defined by the user's hand position and hand shape. In addition, the present invention relates to a mouse event input method of a wearable augmented reality device using hand gestures, and more particularly, as a mouse event input method of a wearable augmented reality device, (1) by mutually corresponding hand gesture events and mouse events. setting; (2) obtaining the joint coordinates of the user's hand from the image taken by the wearable augmented reality device; (3) detecting a hand motion defined by a hand position and a hand shape using the joint coordinates obtained in step (2); (4) detecting a change in the hand motion as a hand motion event using the hand motion detected in the image; and (5) extracting a mouse event corresponding to the detected hand motion event according to the setting of step (1), controlling the wearable augmented reality device according to the extracted mouse event, and implementing a mouse function using hand motion It is characterized in that the hand motion event is defined as a change over a predetermined time of a hand motion defined by the user's hand position and hand shape. According to the wearable augmented reality device for inputting a mouse event using hand gestures proposed in the present invention and the mouse event input method for the wearable augmented reality device using hand gestures, the user's hand position and By detecting hand gestures defined by the shape of a hand and extracting and controlling a mouse event corresponding to a hand gesture event defined as a change in hand gesture, the mouse function is implemented in the wearable augmented reality device using hand gestures, allowing the user to use a separate gesture or input It is possible to easily control the wearable augmented reality device with hand gestures similar to the existing mouse input method without having to learn or remember the method.
机译:可穿戴增强现实设备技术领域本发明涉及一种用于使用手势输入鼠标事件的可穿戴增强现实设备,更具体地,涉及可穿戴的增强现实设备,包括:用于设置手势事件的设置单元和鼠标事件以对应于每个的鼠标事件其他;用于从可穿戴增强现实设备拍摄的图像获取用户手的联合坐标的联合收购单元;一种手动检测单元,用于检测由手部位置和手形的手动运动,使用通过接头获得单元获得的接合坐标;一种事件检测单元,通过使用在图像中检测到的手势来检测手势的变化作为手势事件;以及控制单元,其根据所述设定部的设定对应于检测到的手的运动事件鼠标事件提取物,控制可佩戴增强现实装置根据所提取的鼠标事件,并实现了一种使用鼠标功能的手的移动,所述的手部动作事件的特征在于它被定义为由用户手势和手形状限定的手动运动的预定时间上的变化。此外,本发明涉及使用手势的可穿戴式增强现实设备的鼠标事件输入方法,更具体地,作为可穿戴的增强现实设备的鼠标事件输入方法,(1)通过相互对应的手势事件和鼠标事件。环境; (2)从可穿戴增强现实设备拍摄的图像中获取用户手的关节坐标; (3)使用步骤(2)中获得的关节坐标检测由手位置和手形状定义的手动运动; (4)使用在图像中检测到的手动运动检测手动运动的变化; (5)根据步骤(1)的设置,提取与检测到的手动事件对应的鼠标事件,根据提取的鼠标事件控制可佩戴的增强现实设备,并使用手动运动的鼠标功能表征手动运动事件被定义为由用户手势和手形状限定的手动运动的预定时间上的改变。根据可穿戴的增强现实设备,用于使用本发明中提出的手势和使用手势的可穿戴的增强现实设备的鼠标事件输入方法输入鼠标事件,使用手势,用户的手势和通过检测由形状定义的手势一只手和提取和控制与手势事件相对应的鼠标事件定义为手势手势的变化,使用手势在可穿戴的增强现实设备中实现鼠标功能,允许用户使用单独的手势或输入可以通过类似于现有的鼠标输入方法,轻松控制可穿戴的增强现实设备,而无需学习或记住该方法。

著录项

  • 公开/公告号KR102286018B1

    专利类型

  • 公开/公告日2021-08-05

    原文格式PDF

  • 申请/专利权人

    申请/专利号KR1020200115666

  • 发明设计人 최치원;김정환;조성동;

    申请日2020-09-09

  • 分类号G06F3/01;G06F3/038;G06K9;G06N5/04;G06T19;

  • 国家 KR

  • 入库时间 2022-08-24 20:27:45

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号