首页> 外文期刊>International journal of computational linguistics and applications >Term Evaluator: A Tool for Terminology Annotation and Evaluation
【24h】

Term Evaluator: A Tool for Terminology Annotation and Evaluation

机译:术语评估器:术语注释和评估工具

获取原文
获取原文并翻译 | 示例
           

摘要

There are several methods and available tools for terminology extraction, but the quality of the extracted terms is not always high. Hence, an important consideration in terminology extraction is to assess the quality of the extracted terms. In this paper, we propose and make available a tool for annotating the correctness of terms extracted by three term-extraction tools. This tool facilitates term annotation by using a domain-specific dictionary, a set of filters, and an annotation memory, and allows for post-hoc evaluation. We present a study in which two human judges used the developed tool for term annotation. Their annotations were then analyzed to determine the efficiency of term extraction tools by measures of precision, recall, and F-score, and to calculate the inter-annotator agreement rate.
机译:有几种方法和可用的工具可以提取术语,但是提取的术语的质量并不总是很高。因此,术语提取中的一个重要考虑因素是评估提取术语的质量。在本文中,我们提出并提供了一种工具,用于注释由三个术语提取工具提取的术语的正确性。该工具通过使用特定于域的词典,一组过滤器和注释存储器来促进术语注释,并允许事后评估。我们提出了一项研究,其中两名人类法官使用已开发的工具进行术语注释。然后分析他们的注释,以通过精度,召回率和F分数来确定术语提取工具的效率,并计算注释者之间的一致率。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号