...
首页> 外文期刊>Multimedia Tools and Applications >Interactive 3D content insertion in images for multimedia applications
【24h】

Interactive 3D content insertion in images for multimedia applications

机译:在多媒体应用程序中将交互式3D内容插入图像

获取原文
获取原文并翻译 | 示例
           

摘要

This article addresses the problem of creating interactive mixed reality applications where virtual objects interact in images of real world scenarios. This is relevant to create games and architectural or space planning applications that interact with visual elements in the images such as walls, floors and empty spaces. These scenarios are intended to be captured by the users with regular cameras or using previously taken photographs. Introducing virtual objects in photographs presents several challenges, such as pose estimation and the creation of a visually correct interaction between virtual objects and the boundaries of the scene. The two main research questions addressed in this article include, the study of the feasibility of creating interactive augmented reality (AR) applications where virtual objects interact in a real world scenario using the image detected high-level features and, also, verifying if untrained users are capable and motivated enough to perform AR initialization steps. The proposed system detects the scene automatically from an image with additional features obtained using basic annotations from the user. This operation is significantly simple to accommodate the needs of non-expert users. The system analyzes one or more photos captured by the user and detects high-level features such as vanishing points, floor and scene orientation. Using these features it will be possible to create mixed and augmented reality applications where the user interactively introduces virtual objects that blend with the picture in real time and respond to the physical environment. To validate the solution several system tests are described and compared using available external image datasets.
机译:本文解决了创建交互式混合现实应用程序的问题,在该应用程序中,虚拟对象在现实世界场景的图像中进行交互。这与创建游戏和建筑或空间规划应用程序有关,这些应用程序与图像中的视觉元素(例如墙,地板和空白空间)进行交互。这些场景旨在由用户使用常规相机或使用先前拍摄的照片来捕获。在照片中引入虚拟对象提出了一些挑战,例如姿势估计以及虚拟对象与场景边界之间的视觉正确交互的创建。本文解决的两个主要研究问题包括:研究创建交互式增强现实(AR)应用程序的可行性,在该应用程序中,虚拟对象使用图像检测到的高级功能在真实场景中进行交互,并且还验证未经培训的用户是否具有足够的能力和动力去执行AR初始化步骤。所提出的系统利用具有来自用户的基本注释而获得的附加特征,从图像中自动检测场景。此操作非常简单,可以满足非专业用户的需求。该系统分析用户捕获的一张或多张照片,并检测高级特征,例如消失点,地板和场景方向。使用这些功能,可以创建混合和增强现实应用程序,用户可以在其中交互式地引入虚拟对象,这些虚拟对象与图片实时融合并响应物理环境。为了验证该解决方案,描述了一些系统测试,并使用可用的外部图像数据集进行了比较。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号