首页> 外文会议>Conference on empirical methods in natural language processing >NITE: A Neural Inductive Teaching Framework for Domain-Specific NER
【24h】

NITE: A Neural Inductive Teaching Framework for Domain-Specific NER

机译:NITE:针对特定领域的NER的神经归纳教学框架

获取原文

摘要

In domain-specific NER, due to insufficient labeled training data, deep models usually fail to behave normally. In this paper, we proposed a novel Neural Inductive TEaching framework (NITE) to transfer knowledge from existing domain-specific NER models into an arbitrary deep neural network in a teacher-student training manner. NITE is a general framework that builds upon transfer learning and multiple instance learning, which collaboratively not only transfers knowledge to a deep student network but also reduces the noise from teachers. NITE can help deep learning methods to effectively utilize existing resources (i.e., models, labeled and unlabeled data) in a small domain. The experiment resulted on Disease NER proved that without using any labeled data, NITE can significantly boost the performance of a CNN-bidirectional LSTM-CRF NER neural network nearly over 30% in terms of Fl-score.
机译:在特定于域的NER中,由于标记的训练数据不足,深层模型通常无法正常运行。在本文中,我们提出了一种新颖的神经归纳教学框架(NITE),以师生训练的方式将知识从现有的特定领域NER模型转移到任意深度神经网络中。 NITE是一个基于迁移学习和多实例学习的通用框架,它不仅可以将知识转移到深层的学生网络中,而且可以减少教师的干扰。 NITE可以帮助深度学习方法在小范围内有效利用现有资源(即模型,标记和未标记的数据)。在Disease NER上进行的实验证明,在不使用任何标记数据的情况下,NITE可以显着提高CNN双向LSTM-CRF NER神经网络的性能(按Fl评分计算将近30%以上)。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号