首页> 外文期刊>Information Processing & Management >Questionnaire mode effects in interactive information retrieval experiments
【24h】

Questionnaire mode effects in interactive information retrieval experiments

机译:交互信息检索实验中问卷模式的影响

获取原文
获取原文并翻译 | 示例
       

摘要

The questionnaire is an important technique for gathering data from subjects during interactive information retrieval (IR) experiments. Research in survey methodology, public opinion polling and psychology has demonstrated a number of response biases and behaviors that subjects exhibit when responding to questionnaires. Furthermore, research in human-computer interaction has demonstrated that subjects tend to inflate their ratings of systems when completing usability questionnaires. In this study we investigate the relationship between questionnaire mode and subjects' responses to a usability questionnaire comprised of closed and open questions administered during an interactive IR experiment. Three questionnaire modes (pen-and-paper, electronic and interview) were explored with 51 subjects who used one of two information retrieval systems. Results showed that subjects' quantitative evaluations of systems were significantly lower in the interview mode than in the electronic mode. With respect to open questions, subjects in the interview mode used significantly more words than subjects in the pen-and-paper or electronic modes to communicate their responses, and communicated a significantly higher number of response units, even though the total number of unique response units was roughly the same across condition. Finally, results showed that subjects in the pen-and-paper mode were the most efficient in communicating their responses to open questions. These results suggest that researchers should use the interview mode to elicit responses to closed questions from subjects and either pen-and-paper or electronic modes to elicit responses to open questions.
机译:问卷是在交互式信息检索(IR)实验期间从受试者收集数据的重要技术。在调查方法,民意测验和心理学方面的研究表明,受试者在回答问卷时表现出许多回答偏差和行为。此外,对人机交互的研究表明,受试者在填写可用性调查表时往往会夸大其对系统的评价。在这项研究中,我们调查了问卷模式与受试者对可用性问卷的反应之间的关系,该问卷由在交互式IR实验中进行的封闭式和开放式问题组成。调查了51种使用两种信息检索系统之一的受试者的三种问卷模式(纸笔,电子和访谈)。结果表明,受访者对系统的定量评估在访谈模式下明显低于电子模式。关于开放式问题,采访模式下的受试者使用的单词要比纸笔或电子模式下的受试者传达的单词要多得多,即使独特回答的总数也要多得多各条件下的单位大致相同。最后,结果表明,笔和纸模式的受试者在传达他们对未解决问题的回答方面最有效。这些结果表明,研究人员应使用访谈模式引起对主题的未解决问题的回答,而笔或纸或电子模式应引起对开放性问题的回答。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号