• 主题
高级搜索  >
历史搜索 清空历史
首页> 外文会议>International Conference on Web Research >A review on web search engines' automatic evaluation methods and how to select the evaluation method
【24h】

A review on web search engines' automatic evaluation methods and how to select the evaluation method

机译：网络搜索引擎的自动评估方法以及如何选择评估方法的综述

获取原文
页面导航
  • 摘要
  • 著录项
  • 相似文献
  • 相关主题

摘要

Nowadays search engines are recognized as the pathway for accessing the tremendous amount of information in the internet. They provide aids and services for solving users' different information needs. Thus, being able to evaluate their effectiveness and performance is constantly gaining importance because these evaluations are useful for both developers and users of search engines. Developers can use the evaluation results for improving their strategies and paradigms in the development of search engines. Users, on the other hand, can identify the best performing search engines and in a better, quicker and more accurate way, gratify their information needs. Evaluation of search engines can be done in two different ways; either manually using human arbitrators or automatically using automatic machinery approaches which do not use human arbitrators and their judgments. In the case of manual evaluation methods, by now numerous and standard activities had been carried out by organizers and participants of conferences like TREC or CLEF. In the case of automatic evaluation methods, unlike variety of efforts which had been done by different researchers, no categorization and organization of such methods exists so far. As a result, anyone that wants to use one of the automatic evaluation methods must read all the relevant literature of these methods which is very time consuming and confusing activity. In this paper, we have reviewed almost all the important reported automatic methods for evaluation of search engines. Analyzing the results of this review, we have stated the requirements and prerequisites of using any of these methods. At the end, a framework for selecting the best pertinent method for each evaluation scenario has been suggested. Instead, automatic methods of evaluation are cheaper and faster to be performed.
机译：如今，搜索引擎已被视为访问Internet上大量信息的途径。它们为解决用户的不同信息需求提供了帮助和服务。因此，能够评估其有效性和性能的重要性不断提高，因为这些评估对于搜索引擎的开发人员和用户都是有用的。开发人员可以使用评估结果来改进其在搜索引擎开发中的策略和范例。另一方面，用户可以识别性能最佳的搜索引擎，并以更好，更快和更准确的方式满足他们的信息需求。可以通过两种不同的方式对搜索引擎进行评估：要么手动使用人工仲裁员，要么自动使用不使用人工仲裁员及其判断的自动机器方法。对于手动评估方法，到目前为止，TREC或CLEF之类的会议的组织者和参与者已经进行了许多标准的活动。在自动评估方法的情况下，与不同研究人员所做的各种努力不同，到目前为止，尚无此类方法的分类和组织。结果，任何想要使用自动评估方法之一的人都必须阅读这些方法的所有相关文献，这是非常耗时且令人困惑的活动。在本文中，我们回顾了几乎所有重要的自动评估搜索引擎的方法。通过分析本次审查的结果，我们已经说明了使用这些方法中的任何一种的要求和先决条件。最后，提出了为每个评估方案选择最佳相关方法的框架。相反，自动评估方法更便宜且执行速度更快。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱：kefu@zhangqiaokeyan.com

京公网安备：11010802029741号 ICP备案号：京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有

  • 客服微信

  • 服务号