首页> 外文期刊>AI communications >Aesop: A visual storytelling platform for conversational AI and common sense grounding
【24h】

Aesop: A visual storytelling platform for conversational AI and common sense grounding

机译:AESOP:用于对话AI和常识接地的视觉讲故事平台

获取原文
获取原文并翻译 | 示例
       

摘要

We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Our system operates in two main modes, common sense grounding (annotation) and conversation. The Aesop system senses the human state and input using a natural language parser and human gesture monitoring for natural interactions. The interface consists of a 3D animation software and a web controller to interact with the internal state of the system. For knowledge representation, we formulate novel knowledge graphs which enable spatio-temporal event representation. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Finally, the system utilizes a dialog manager to track the conversation state and manage goals. Aesop provides a rich platform that enables research in language, gestures, vision, and planning in the context of storytelling.
机译:我们提供了一个新的协作视觉讲故事平台,AESOP,方向和动画。我们的系统以两个主要模式运行,常识接地(注释)和对话。 AESOP系统在使用自然语言解析器和人体手势监测的自然相互作用来感知人类状态和输入。该接口由3D动画软件和Web控制器组成,用于与系统的内部状态交互。对于知识表示,我们制定了新颖的知识图,它能够实现时空事件表示。因此,AESOP使3D空间和时间推理能够对讲故事至关重要。最后,系统利用对话管理器跟踪对话状态并管理目标。 AESOP提供丰富的平台,可以在讲故事的背景下以语言,手势,愿景和规划研究。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号