...
首页> 外文期刊>Information retrieval >Fusing different information retrieval systems according to query-topics: a study based on correlation in information retrieval systems and TREC topics
【24h】

Fusing different information retrieval systems according to query-topics: a study based on correlation in information retrieval systems and TREC topics

机译:根据查询主题融合不同的信息检索系统:基于信息检索系统和TREC主题相关性的研究

获取原文
获取原文并翻译 | 示例
           

摘要

To evaluate Information Retrieval Systems on their effectiveness, evaluation programs such as TREC offer a rigorous methodology as well as benchmark collections. Whatever the evaluation collection used, effectiveness is generally considered globally, averaging the results over a set of information needs. As a result, the variability of system performance is hidden as the similarities and differences from one system to another are averaged. Moreover, the topics on which a given system succeeds or fails are left unknown. In this paper we propose an approach based on data analysis methods (correspondence analysis and clustering) to discover correlations between systems and to find trends in topic/system correlations. We show that it is possible to cluster topics and systems according to system performance on these topics, some system clusters being better on some topics. Finally, we propose a new method to consider complementary systems as based on their performances which can be applied for example in the case of repeated queries. We consider the system profile based on the similarity of the set of TREC topics on which systems achieve similar levels of performance. We show that this method is effective when using the TREC ad hoc collection.
机译:为了评估信息检索系统的有效性,诸如TREC之类的评估程序提供了严格的方法以及基准收集。无论使用哪种评估收集,通常都会在全球范围内考虑有效性,将结果根据一组信息需求进行平均。结果,隐藏了系统性能的可变性,因为平均了一个系统与另一个系统之间的相似性和差异。而且,给定系统成功或失败的主题仍然未知。在本文中,我们提出一种基于数据分析方法(对应分析和聚类)的方法,以发现系统之间的相关性并找到主题/系统相关性的趋势。我们表明,可以根据在这些主题上的系统性能对主题和系统进行聚类,其中某些系统集群在某些主题上更好。最后,我们提出了一种基于互补系统性能来考虑互补系统的新方法,该方法可用于例如重复查询的情况。我们基于TREC主题集的相似性来考虑系统配置文件,在这些主题上,系统可以获得相似的性能水平。我们证明了使用TREC ad hoc集合时该方法是有效的。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号