首页> 外文会议>IEEE International Symposium on Software Reliability Engineering >Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors
【24h】

Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors

机译:体验报告:使用多个因素自动确定系统级别回归测试的优先级

获取原文

摘要

We propose a new method of determining an effective ordering of regression test cases, and describe its implementation as an automated tool called SuiteBuilder developed by Westermo Research and Development AB. The tool generates an efficient order to run the cases in an existing test suite by using expected or observed test duration and combining priorities of multiple factors associated with test cases, including previous fault detection success, interval since last executed, and modifications to the code tested. The method and tool were developed to address problems in the traditional process of regression testing, such as lack of time to run a complete regression suite, failure to detect bugs in time, and tests that are repeatedly omitted. The tool has been integrated into the existing nightly test framework for Westermo software that runs on large-scale data communication systems. In experimental evaluation of the tool, we found significant improvement in regression testing results. The re-ordered test suites finish within the available time, the majority of fault-detecting test cases are located in the first third of the suite, no important test case is omitted, and the necessity for manual work on the suites is greatly reduced.
机译:我们提出了一种确定回归测试用例的有效排序的新方法,并将其实现描述为由Westermo Research and Development AB开发的称为SuiteBuilder的自动化工具。该工具通过使用预期或观察到的测试持续时间,并结合与测试用例相关的多个因素的优先级,包括先前的故障检测成功率,自上次执行以来的间隔以及对测试代码的修改,来生成有效的订单,以在现有测试套件中运行用例。开发了该方法和工具以解决传统回归测试过程中的问题,例如缺少时间来运行完整的回归套件,无法及时检测到错误以及反复被忽略的测试。该工具已集成到Westermo软件的现有夜间测试框架中,该框架在大规模数据通信系统上运行。在对该工具的实验评估中,我们发现回归测试结果有了显着改善。重新排序的测试套件将在可用时间内完成,大多数故障检测测试用例位于套件的前三分之一中,不会省略重要的测试用例,并且极大地减少了套件上手动工作的必要性。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号