...
  • 主题
高级搜索  >
历史搜索 清空历史
首页> 外文期刊>Science of Computer Programming >Empirically evaluating Greedy-based test suite reduction methods at different levels of test suite complexity
【24h】

Empirically evaluating Greedy-based test suite reduction methods at different levels of test suite complexity

机译：在不同级别的测试套件复杂性上以经验评估基于贪婪的测试套件简化方法

获取原文
获取原文并翻译 | 示例
           
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Test suite reduction is an important approach that decreases the cost of regression testing. A test suite reduction technique operates based on the relationship between the test cases in the regression test suite and the test requirements in the program under test. Thus, its effectiveness should be closely related to the complexity of a regression test suite - the product of the number of test cases and the number of test requirements. Our previous work has shown that cost-aware techniques (i.e., the test suite reduction techniques that aim to decrease the regression test suite's execution cost) generally outperform the others in terms of decreasing the cost of running the regression test suite. However, the previous empirical studies that evaluated cost-aware techniques did not take into account test suite complexity. That is, prior experiments do not reveal if the cost-aware techniques scale and work effectively on test suites with more test cases and more test requirements. This means that prior experiments do not appropriately shed light on how well test suite reduction methods work with large programs or test suites. Therefore, this paper focuses on the Greedy-based techniques and empirically evaluates the additional Greedy and two cost-aware Greedy techniques - at different levels of test suite complexity - from various standpoints including the cost taken to run the regression test suite, the time taken to reduce the test suites, the total regression testing costs, the fault detection capability, the fault detection efficiency, and the common rates of the representative sets. To the best of our knowledge, none of the previous empirical studies classify a considerable number of test suites according to their complexity. Nor do any prior experiments evaluate the test suite reduction techniques, in terms of the aforementioned criteria, at different levels of test suite complexity. This paper represents the first such attempt to carry out this important task. Based on the empirical results, we confirm the strengths and weaknesses of the cost-aware techniques and develop insights into how the cost-aware techniques' effectiveness varies as the test suite complexity increases.
机译：减少测试套件是一种降低回归测试成本的重要方法。测试套件简化技术基于回归测试套件中的测试用例与被测程序中的测试需求之间的关系进行操作。因此，其有效性应与回归测试套件的复杂性密切相关，该复杂性是测试用例数量与测试需求数量的乘积。我们以前的工作表明，成本感知技术（即旨在降低回归测试套件执行成本的测试套件缩减技术）在降低运行回归测试套件的成本方面通常优于其他技术。但是，以前的评估成本意识技术的经验研究没有考虑测试套件的复杂性。也就是说，以前的实验无法揭示成本意识技术是否可以在具有更多测试用例和更多测试需求的测试套件上扩展并有效地工作。这意味着先前的实验无法适当地揭示测试套件缩减方法在大型程序或测试套件中的工作情况。因此，本文侧重于基于贪婪的技术，并从不同角度从经验的角度评估了额外的贪婪和两种具有成本意识的贪婪技术（在测试套件复杂性的不同级别上），包括运行回归测试套件所需的成本，所花费的时间以减少测试套件，总回归测试成本，故障检测能力，故障检测效率以及代表集的通用率。据我们所知，以前的经验研究均未根据其复杂性对大量测试套件进行分类。先前的实验也没有根据上述标准在不同级别的测试套件复杂性上评估测试套件缩减技术。本文代表了完成这项重要任务的首次尝试。基于经验结果，我们确认了成本意识技术的优缺点，并深入了解了成本意识技术的有效性如何随测试套件复杂性的增加而变化。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号