...
  • 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>IEEE transactions on multimedia >Perceiving Graphical and Pictorial Information via Hearing and Touch
【24h】

Perceiving Graphical and Pictorial Information via Hearing and Touch

机译：通过听觉和触觉感知图形和图形信息

获取原文
获取原文并翻译 | 示例
   

获取外文期刊封面封底 >>

       
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

We propose a dynamic interactive system for conveying visual information via hearing and touch to blind and visually impaired people. The system is implemented with a touch screen that allows the user to actively explore a two-dimensional layout consisting of one or more objects with the finger while listening to auditory feedback. Sound is used as the primary source of information for object localization, identification, and shape, while touch is used for pointing and kinesthetic feedback. A static overlay of raised-dot tactile patterns can also be added. The head-related transfer function is used for rendering sound directionality, and variations of sound intensity or other features are used for rendering proximity. The main focus is on conveying the shape of an object, but the rendering of a simple scene layout, that consists of objects in a linear arrangement, each with a distinct tapping sound, is also considered and compared to a “virtual cane.” We consider a number of acoustic-tactile configurations and use empirical studies with visually blocked sighted participants to compare their effectiveness. Our findings demonstrate the advantages of spatial sound (directionality and proximity cues) for dynamic display of information (localization, identification, shape), while raised-dot patterns provide the best static shape rendition. We also show that the proposed configurations outperform existing techniques. The proposed approach is also expected to impact other applications where vision cannot be used.
机译：我们提出了一种动态交互式系统，用于通过听力和触摸向盲人和视障人士传达视觉信息。该系统由触摸屏实现，该触摸屏允许用户在听听反馈的同时，主动用手指探索由一个或多个对象组成的二维布局。声音被用作对象定位，识别和形状的主要信息源，而触摸则被用于指向和动觉反馈。还可以添加凸起的点触模式的静态覆盖。与头部有关的传递函数用于呈现声音的方向性，而声音强度或其他特征的变化用于呈现接近性。主要重点是传达对象的形状，但是也考虑了将简单的场景布局（由线性排列的对象组成，每个对象具有不同的敲击声）进行渲染并将其与“虚拟手杖”进行比较。我们考虑了许多声触觉配置，并通过对视障者的经验研究来比较其效果。我们的发现证明了空间声音（方向性和接近性提示）在动态显示信息（定位，识别，形状）方面的优势，而凸起的点图案可提供最佳的静态形状再现。我们还表明，提出的配置优于现有技术。预期所提出的方法还将影响无法使用视觉的其他应用。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号