首页> 外文会议>International Conference on Automatic Face and Gesture Recognition >Head Pose and Expression Transfer using Facial Status Score
【24h】

Head Pose and Expression Transfer using Facial Status Score

机译:使用面部状态分数的头部姿势和表达转移

获取原文

摘要

We propose a method to transfer both head pose and facial expression of a source person in a video to the face of a target person in an output video. Our method models the entire 2D frame instead of the 3D face, and it generates output results using a status score, which includes the relative facial status about the head pose and expression in a frame. From the target video, the learning process obtains frame features needed for moving to each frame from the neutral frame for all frames, and generates the basis of these features via principal component analysis (PCA). Then, it learns to generate these features from a given status score sequentially. In the transfer process, it obtains a status score from a source frame of the video and generates the features from the given status score. Then, it generates the output frame using the reconstructed features. An output video is generated by repeating these steps for each source frame. Our method generates output results on the trajectory of the target video by using the advantage of PCA. Therefore, in the output results generated by our methods, both head pose and expression are transferred correctly while the non-face regions of the frames are supported. Finally, we experimentally compare the effectiveness of our method and conventional methods.
机译:我们提出了一种方法来将源人的头部姿势和面部表达转移到输出视频中的目标人的面部。我们的方法模拟整个2D帧而不是3D面,并且它使用状态分数生成输出结果,其包括关于头部姿势的相对面部状态和帧中的表达式。从目标视频中,学习过程获得从所有帧的中性帧移动到每个帧所需的帧特征,并通过主成分分析(PCA)生成这些特征的基础。然后,它学会顺序地从给定的状态分数生成这些功能。在传送过程中,它从视频的源帧获得状态分数,并从给定的状态分数生成特征。然后,它使用重建的功能生成输出帧。通过对每个源帧重复这些步骤来生成输出视频。我们的方法通过使用PCA的优势,在目标视频的轨迹上生成输出结果。因此,在由我们的方法产生的输出结果中,在支持帧的非面积区域的同时正确地传送头部姿势和表达。最后,我们通过实验比较了我们方法和传统方法的有效性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号