【24h】

Liquid Benchmarks: Benchmarking-as-a-Service

机译:流动基准:即服务即基准

获取原文
获取原文并翻译 | 示例

摘要

Experimental evaluation and comparison of techniques, algorithms or complete systems is a crucial requirement to assess the practical impact of research results. The quality of published experimental results is usually limited due to several reasons such as: limited time, unavailability of standard benchmarks or shortage of computing resources. Moreover, achieving an independent, consistent, complete and insightful assessment for different alternatives in the same domain is a time and resource consuming task. We demonstrate Liquid Benchmark as a cloud-based service that provides collaborative platforms to simplify the task of peer researchers in performing high quality experimental evaluations and guarantee a transparent scientific crediting process. The service allows building repositories of competing research implementations, sharing testing computing platforms, collaboratively building the specifications of standard benchmarks and allowing end-users to easily create and run testing experiments and share their results.
机译:实验评估和技术,算法或完整系统的比较是评估研究结果的实际影响的关键要求。通常由于以下几个原因而限制了已发布的实验结果的质量:有限的时间,标准基准的不可用或计算资源的短缺。此外,对同一域中的不同替代方案进行独立,一致,完整和有见地的评估是一项耗时和资源的任务。我们将Liquid Benchmark演示为基于云的服务,它提供协作平台以简化同行研究人员执行高质量实验评估的任务,并确保透明的科学入账流程。该服务允许建立竞争性研究实施的存储库,共享测试计算平台,协作构建标准基准的规范,并允许最终用户轻松创建和运行测试实验并共享其结果。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号