• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>ACM Transactions on Interactive Intelligent Systems >Gaze Awareness in Conversational Agents: Estimating a User's Conversational Engagement from Eye Gaze
【24h】

Gaze Awareness in Conversational Agents: Estimating a User's Conversational Engagement from Eye Gaze

机译：会话代理中的注视意识：从眼睛注视估计用户的会话参与度

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

In face-to-face conversations, speakers are continuously checking whether the listener is engaged in the conversation, and they change their conversational strategy if the listener is not fully engaged. With the goal of building a conversational agent that can adaptively control conversations, in this study we analyze listener gaze behaviors and develop a method for estimating whether a listener is engaged in the conversation on the basis of these behaviors. First, we conduct a Wizard-of-Oz study to collect information on a user's gaze behaviors. We then investigate how conversational disengagement, as annotated by human judges, correlates with gaze transition, mutual gaze (eye contact) occurrence, gaze duration, and eye movement distance. On the basis of the results of these analyses, we identify useful information for estimating a user's disengagement and establish an engagement estimation method using a decision tree technique. The results of these analyses show that a model using the features of gaze transition, mutual gaze occurrence, gaze duration, and eye movement distance provides the best performance and can estimate the user's conversational engagement accurately. The estimation model is then implemented as a real-time disengagement judgment mechanism and incorporated into a multimodal dialog manager in an animated conversational agent. This agent is designed to estimate the user's conversational engagement and generate probing questions when the user is distracted from the conversation. Finally, we evaluate the engagement-sensitive agent and find that asking probing questions at the proper times has the expected effects on the user's verbalonverbal behaviors during communication with the agent. We also find that our agent system improves the user's impression of the agent in terms of its engagement awareness, behavior appropriateness, conversation smoothness, favorability, and intelligence.
机译：在面对面的对话中，发言人会不断检查听众是否参与了对话，如果听众没有完全参与，他们会更改其对话策略。为了建立一个可以自适应控制对话的对话代理，在本研究中，我们分析了听众的注视行为，并开发了一种基于这些行为来估计听众是否参与对话的方法。首先，我们进行了绿野仙踪研究，以收集有关用户注视行为的信息。然后，我们调查人类判断者注释的对话脱离与注视过渡，相互注视（眼神接触）发生，注视持续时间和眼动距离之间的关系。基于这些分析的结果，我们确定了用于估计用户脱离接触的有用信息，并使用决策树技术建立了接触估计方法。这些分析的结果表明，使用注视过渡，相互注视发生，注视持续时间和眼睛移动距离等特征的模型可以提供最佳性能，并且可以准确地估计用户的对话参与度。然后，将估计模型实现为实时脱离判断机制，并将其合并到动画对话代理中的多模式对话管理器中。该代理旨在估计用户的对话参与度，并在用户从对话中分散注意力时生成探测问题。最后，我们评估了对参与度敏感的代理，发现在适当的时间提出探测问题对与代理进行通信时用户的言语/非言语行为具有预期的影响。我们还发现，我们的座席系统从其参与意识，行为适当性，对话顺畅性，可取性和智能性方面改善了用户对座席的印象。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号