首页> 外文期刊>Reliability Engineering & System Safety >Benchmarking static code analyzers
【24h】

Benchmarking static code analyzers

机译:基准静态代码分析仪

获取原文
获取原文并翻译 | 示例
           

摘要

We show that a widely used benchmark set for the comparison of static" = analysis tools exhibits an impressive number of weaknesses, and that the internationally accepted quantitative" = evaluation metrics may lead to useless results. The weaknesses in the benchmark set were identified by applying a sound static analysis to the programs in this set and carefully interpreting the results. We propose how to deal with weaknesses of the quantitative metrics and how to improve such benchmarks and the evaluation process, in particular for external evaluations, in which an ideally neutral institution does the evaluation, whose results potential clients can trust. We also show that sufficiently high quality of the test cases makes an automatic result evaluation possible.
机译:我们表明,用于比较静态“=分析工具的广泛使用的基准集合呈现出令人印象深刻的弱点,并且国际公认的量化”=评估指标可能导致无用的结果。通过对此集合中的程序应用声音静态分析并仔细解释结果来识别基准组中的弱点。我们建议如何应对定量指标的弱点以及如何改进此类基准以及评估过程,特别是对外部评估,其中一个理想的中立机构进行评估,其结果潜在客户可以信任。我们还表明,足够高的测试用例质量使得自动结果评估成为可能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号