首页> 外文期刊>AI communications >Aesop: A visual storytelling platform for conversational AI and common sense grounding
【24h】

Aesop: A visual storytelling platform for conversational AI and common sense grounding

机译:Aesop:用于对话式AI和常识性基础的视觉叙事平台

获取原文
获取原文并翻译 | 示例
       

摘要

We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring for natural interactions. The interface consists of a 3D animation software and a web controller to interact with the internal state of the system. For knowledge representation, we formulate novel knowledge graphs which enable spatio-temporal event representation. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Finally, the system utilizes a dialog manager to track the conversation state and manage goals. Aesop provides a rich platform that enables research in language, gestures, vision, and planning in the context of storytelling.
机译:我们提供了一个新的协作式视觉故事讲述平台Aesop,用于指导和动画制作。我们的系统以两种主要模式运行:常识性接地(注释)和对话。 Aesop系统使用自然语言解析器和人类手势监视来感知人类状态和输入,以进行自然交互。该界面由3D动画软件和网络控制器组成,可与系统的内部状态进行交互。对于知识表示,我们制定了能够实现时空事件表示的新颖知识图。因此,Aesop实现了3D空间和时间推理,这对于讲故事来说都是必不可少的。最后,系统利用对话管理器来跟踪对话状态并管理目标。 Aesop提供了一个丰富的平台,可以在讲故事的背景下进行语言,手势,视觉和计划方面的研究。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号