首页> 外文会议>International Conference on e-Business and Telecommunications >MULTIMODAL INTERACTION WITH MOBILE DEVICES: Outline of a Semiotic Framework for Theory and Practice
【24h】

MULTIMODAL INTERACTION WITH MOBILE DEVICES: Outline of a Semiotic Framework for Theory and Practice

机译:与移动设备的多模式互动:理论与实践的符号框架概要

获取原文

摘要

This paper explores how interfaces that fully uses our ability to communicate through the visual, auditory, and tactile senses, may enhance mobile interaction. The first step is to look beyond the desktop. We do not need to reinvent computing, but we need to see that mobile interaction does not benefit from desktop metaphors alone. The next step is to look at what we have at hand, and as we will see, mobile devices are already quite apt for multimodal interaction. The question is how we can coordinate information communicated through several senses in a way that enhances interaction. By mapping information over communication circuit, semiotic representation, and sense applied for interaction; a framework for multimodal interaction is outlined that can offer some guidance to integration. By exemplifying how a wide range of research prototypes fit into the framework today, it is shown how interfaces communicating through several modalities may enhance mobile interaction tomorrow.
机译:本文探讨了充分利用我们通过视觉,听觉和触觉感应进行通信的界面的界面如何增强移动交互。第一步是超越桌面。我们不需要重新调试计算,但我们需要看到移动互动并不能仅从桌面隐喻中受益。下一步是看看我们在手头,而且我们将看到,移动设备已经完全适合多模式交互。问题是我们如何在增强交互的方式中协调通过几种感官传达的信息。通过映射通过通信电路,符号学代表性和施加互动的感知的信息;概述了多模式交互的框架,可以为集成提供一些指导。通过举例说明各种研究原型如何适合今天框架,它显示了通过多种方式通信的接口可能会提高明天的移动互动。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号