首页> 外文期刊>Information and software technology >Test Case Prioritization in Continuous Integration environments: A systematic mapping study
【24h】

Test Case Prioritization in Continuous Integration environments: A systematic mapping study

机译:持续集成环境中的测试案例优先级:系统的映射研究

获取原文
获取原文并翻译 | 示例
           

摘要

Context Continuous Integration (CI) environments allow frequent integration of software changes, making software evolution more rapid and cost-effective. In such environments, the regression test plays an important role, as well as the use of Test Case Prioritization (TCP) techniques. Such techniques attempt to identify the test case order that maximizes certain goals, such as early fault detection. This research subject has been raising interest because some new challenges are faced in the CI context, as TCP techniques need to consider time constraints of the CI environments.Objective: This work presents the results of a systematic mapping study on Test Case Prioritization in Continuous Integration environments (TCPCI) that reports the main characteristics of TCPCI approaches and their evaluation aspects.Method: The mapping was conducted following a plan that includes the definition of research questions, selection criteria and search string, and the selection of search engines. The search returned 35 primary studies classified based on the goal and kind of used TCP technique, addressed CI particularities and testing problems, and adopted evaluation measures.Results: The results show a growing interest in this research subject. Most studies have been published in the last four years. 80% of the approaches are history-based, that is, are based on the failure and test execution history. The great majority of studies report evaluation results by comparing prioritization techniques. The preferred measures are Time and number/percentage of Faults Detected. Few studies address CI testing problems and characteristics, such as parallel execution and test case volatility.Conclusions: We observed a growing number of studies in the field. Future work should explore other information sources such as models and requirements, as well as CI particularities and testing problems, such as test case volatility, time constraint, and flaky tests, to solve existing challenges and offer cost-effective approaches to the software industry.
机译:上下文连续集成(CI)环境允许频繁进行软件更改集成,从而使软件开发更加快速和经济高效。在这样的环境中,回归测试以及测试用例优先级排序(TCP)技术的使用都起着重要的作用。这样的技术试图识别最大化某些目标的测试用例顺序,例如早期故障检测。由于TCP技术需要考虑CI环境的时间限制,该研究主题引起了人们的关注,因为CI领域面临着一些新的挑战。目的:这项工作提出了关于持续集成中测试用例优先级的系统映射研究的结果方法:映射是根据包括研究问题的定义,选择标准和搜索字符串以及搜索引擎的选择的计划进行的。搜索返回了35项基于研究目的和所用TCP技术的类型进行分类的基础研究,解决了CI的特殊性和测试问题,并采取了评估措施。大多数研究已在过去四年中发表。 80%的方法都是基于历史的,即基于故障和测试执行的历史。绝大多数研究通过比较优先排序技术来报告评估结果。首选措施是时间和检测到的故障数/百分比。很少有研究解决CI测试问题和特征,例如并行执行和测试用例的波动性。结论:我们观察到了该领域越来越多的研究。未来的工作应该探索其他信息源,例如模型和需求,以及CI的特殊性和测试问题,例如测试用例的波动性,时间限制和易碎的测试,以解决现有挑战并为软件行业提供经济高效的方法。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号