首页> 外文会议>IEEE International Requirements Engineering Conference Workshops >How Common are Controlled Experiments with Student Participants in Requirements Engineering? - A Systematic Mapping Study on the Use and Reporting of Graduate and Undergraduate Students in Requirements Engineering Experiments
【24h】

How Common are Controlled Experiments with Student Participants in Requirements Engineering? - A Systematic Mapping Study on the Use and Reporting of Graduate and Undergraduate Students in Requirements Engineering Experiments

机译:对需求工程的学生参与者的控制实验有多常见? - 对需求工程实验中毕业生和本科生的使用和报告的系统映射研究

获取原文

摘要

[Context] In requirements engineering research, emphasis is given to sound evaluations of new approaches. While industry surveys or industrial case studies are preferred to evaluate industrial applicability, controlled experiments with student participants are commonly used to determine measurements such as effectiveness and efficiency of a proposed approach. [Objectives] In this paper, we elaborate on the current state of the art of controlled experiments using student participants. As threats regarding the generalizability are quite obvious, we want to determine how widespread controlled experiments with student participants are and in which settings they are used. [Methods] This paper reports on a systematic mapping study using requirements engineering specific conferences and a journal as data sources. We scanned requirements engineering papers published in the years 2010-2015 and investigated all papers reporting student experiments in detail. [Results] From 444 papers under investigation 31 report results from controlled experiments. Regarding threats to validity it can be observed that most papers report on threats to validity and commonly different categories of threats to validity are thoroughly discussed. However, many experiments lack information regarding the students' recruitment and other important factors. [Conclusions] Student participation in requirements engineering experiments can be seen as a common evaluation approach and common threats to validity are appropriately discussed. In contrast, student specific threats to validity in experiments with student participants, such as the recruitment strategy and the bonuses given, are commonly not reported.
机译:[上下文]在需求工程研究中,重点是对新方法的声音评估。虽然行业调查或工业案例研究是优选评估工业实用性的,但与学生参与者的控制实验通常用于确定诸如建议方法的有效性和效率之类的测量。 [目标]在本文中,我们用学生参与者详细说明了对受控实验领域的现状。由于关于概括性的威胁非常明显,我们希望确定学生参与者的广泛控制实验是如何以及在哪些设置中使用它们。 [方法]本文报告了使用需求工程特定会议的系统映射研究以及作为数据来源的日志。我们扫描了2010 - 2015年截至2010-2015年的需求工程论文,并详细探讨了报告学生实验的所有论文。 [结果]从调查下的444篇论文31报告来自受控实验的结果。关于有效性的威胁,可以观察到大多数论文报告有关有效性的威胁以及普通威胁对有效性的威胁进行了彻底。然而,许多实验缺乏有关学生招聘和其他重要因素的信息。 [结论]学生参与要求工程实验可以被视为共同的评估方法,讨论对有效性的共同威胁得到了适当的探讨。相比之下,普遍没有报告学生参与者在与学生参与者的实验中有效性的特定威胁,例如招聘战略和给予的奖金。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号