首页> 外文学位 >Multi-Modal Saliency Fusion for Illustrative Image Enhancement.
【24h】

Multi-Modal Saliency Fusion for Illustrative Image Enhancement.

机译:用于说明性图像增强的多模态显着融合。

获取原文
获取原文并翻译 | 示例

摘要

Digitally manipulated or augmented images are increasingly prevalent. Multi-sensor systems produce augmented images that integrate data into a single context. Mixed-reality images are generated from the insertion of computer generated objects into a natural scene. Digital processing for application-specific tasks (e.g., compression, network transmission) can create images distorted with processing artifacts. Augmentation of digital images can lead to the inclusion of artifacts that influence the perception of the image.;In an augmented image, visual cues (e.g., depth or size cues) may be perceptually inconsistent. A feature deemed important in its local context may not be as important in the broader integrated context. Inserted synthetic objects may not possess the appropriate visual cues for proper perception of the overall scene. In compressed images, finer cues that distinguish critical features may be lost. Enhancing augmented images to add or restore visual cues can improve the image's perceptibility. This dissertation presents a framework for illustrating images to enhance critical features. The enhancements, inspired by an analysis of artists' techniques, bolster the features' perceptual cues and improve the comprehension of the augmented image. The framework uses a linear combination of image (2D), surface topology (3D), and task based saliency measures to identify the critical features in the image. Upon identification, the features are interactively enhanced using a non-photorealistic rendering (NPR) deferred illustration technique. The use of multi-modal saliency allows a visualization designer to adjust the definition of critical features.;The proposed framework provides a generalized, flexible, and extensible approach to enhancing salient features in an augmented image. The framework describes a metric, the Saliency Similarity Metric (SSM), for providing feedback on how closely the salient features of the enhanced image match those of the reference image. This feedback can be used for making informed decisions on tuning the visualization. The benefits of the framework are analyzed through objective and subjective evaluations. The evaluations reveal that illustrative enhancements must be carefully applied for perceptual improvement. The framework provides the flexibility necessary to effectively tune the enhancements to a particular task, data set, or user.
机译:数字处理或增强的图像越来越普遍。多传感器系统生成增强的图像,这些图像将数据集成到单个上下文中。混合现实图像是通过将计算机生成的对象插入自然场景而生成的。针对特定应用任务的数字处理(例如,压缩,网络传输)可能会产生因处理伪影而失真的图像。数字图像的增强可能会导致影响图像感知的伪影的包含。在增强图像中,视觉提示(例如深度或大小提示)可能在感知上不一致。在本地环境中被认为重要的功能在更广泛的集成环境中可能不那么重要。插入的合成对象可能没有适当的视觉提示,无法正确感知整个场景。在压缩的图像中,可能会丢失区分关键特征的更精细的提示。增强增强的图像以添加或恢复视觉提示可以提高图像的可感知性。本文提出了一个框架来说明图像,以增强关键特征。这些增强功能是通过对艺术家的技术进行分析而激发的,从而增强了功能的感知线索,并增强了增强图像的理解力。该框架使用图像(2D),表面拓扑(3D)和基于任务的显着性度量的线性组合来识别图像中的关键特征。识别后,将使用非真实感渲染(NPR)延迟说明技术来交互式增强功能。多模态显着性的使用使可视化设计人员可以调整关键特征的定义。所提出的框架提供了一种通用,灵活和可扩展的方法来增强增强图像中的显着特征。该框架描述了一种度量标准,即显着性相似度量标准(SSM),用于提供有关增强图像的显着特征与参考图像的显着特征匹配程度的反馈。此反馈可用于在调整可视化效果方面做出明智的决定。该框架的好处是通过客观和主观评估来分析的。评估表明,必须对说明性的增强进行仔细的应用以改善感性。该框架提供了必要的灵活性,可以有效地将增强功能调整为特定任务,数据集或用户。

著录项

  • 作者

    Morris, Christopher Joel.;

  • 作者单位

    University of Maryland, Baltimore County.;

  • 授予单位 University of Maryland, Baltimore County.;
  • 学科 Computer Science.
  • 学位 Ph.D.
  • 年度 2014
  • 页码 268 p.
  • 总页数 268
  • 原文格式 PDF
  • 正文语种 eng
  • 中图分类
  • 关键词

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号