首页> 外国专利> SYSTEM AND METHOD FOR TRAINING A CONVOLUTIONAL NEURAL NETWORK AND CLASSIFYING AN ACTION PERFORMED BY A SUBJECT IN A VIDEO USING THE TRAINED CONVOLUTIONAL NEURAL NETWORK

SYSTEM AND METHOD FOR TRAINING A CONVOLUTIONAL NEURAL NETWORK AND CLASSIFYING AN ACTION PERFORMED BY A SUBJECT IN A VIDEO USING THE TRAINED CONVOLUTIONAL NEURAL NETWORK

机译:用于训练卷积神经网络并使用训练后的卷积神经网络对对象在视频中进行的动作进行分类的系统和方法

摘要

A method for training a convolutional neural network for classification of actions performed by subjects in a video is realized by (a) for each frame of the video, for each key point of the subject, generating a heat map of the key point representing a position estimation of the key point within the frame; (b) colorizing each heat map as a function of the relative time of the corresponding frame in the video; (c) for each key point, aggregating all the colorized heat maps of the key point into at least one image representing the evolution of the position estimation of the key point during the video; and training the convolutional neural network using as input the sets associated to each training video of images representing the evolution of the position estimation of each key point during the video.
机译:通过(a)针对视频的每一帧,针对对象的每个关键点,生成表示位置的关键点的热图,来实现一种训练卷积神经网络以对视频中的对象执行的动作进行分类的方法。估计框架内的关键点; (b)根据视频中相应帧的相对时间对每个热图进行着色; (c)对于每个关键点,将关键点的所有彩色热图汇总到至少一个图像中,该图像表示视频中关键点位置估计的变化;使用与图像的每个训练视频相关的集合作为输入来训练卷积神经网络,这些集合表示视频期间每个关键点的位置估计的演变。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号