• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文会议>International Conference on Human-Computer Interaction;International Conference on Universal Access in Human-Computer Interaction >Multimodal Interaction Framework Based on Firebase Real-Time Database
【24h】

Multimodal Interaction Framework Based on Firebase Real-Time Database

机译：基于Firebase实时数据库的多模态交互框架

获取原文
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Relying on one technology with a single interaction modality may benefit some users but would certainly exclude a lot more if they have impedances to use that modality. The solution then becomes the inclusion of multiple modalities in the initial design of the interactive system making it more adaptable to the needs of many more users. Including many modalities can rapidly increase the number of interaction objects that need to receive the stream of user commands. This is especially true if the user needs to interact with multiple artifacts in a home automation environment. In this paper, we present the general architecture of an ongoing project for multimodal home automation system. This system relies on a web based database called Firebase for the exchange of user input and the issuing of commands to the multiple artifacts. The user input is acquired using a smart-phone and a webcam equipped computer. They capture the user's tactile input, vocal phrases, eye gaze as well as head pose features like tilt and face direction. We were able to achieve a reliable data transfer between the database and the different input acquisition interface. As a first step in the prototyping of the system, we were able to control two separate game interfaces developed using Unity 3D software.
机译：依靠单个交互模当的一种技术可能会使一些用户受益，但如果他们有阻抗使用该模态，那么肯定会排除更多。然后解决方案成为在交互式系统的初始设计中包含多种方式，使其更适应更多用户的需求。包括许多模态可以迅速增加需要接收用户命令流的交互对象的数量。如果用户需要与家庭自动化环境中的多种伪像进行交互，则尤其如此。在本文中，我们介绍了多式联运自动化系统的持续项目的一般架构。该系统依赖于名为Firebase的基于Web的数据库，用于交换用户输入和向多种工件发出命令。使用智能手机和设备的计算机获取用户输入。它们捕获用户的触觉输入，声音短迹，眼睛凝视以及头部姿势特征，如倾斜和面向方向。我们能够在数据库和不同的输入采集界面之间实现可靠的数据传输。作为系统原型设计的第一步，我们能够控制使用Unity 3D软件开发的两个单独的游戏接口。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号