Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism

Zhang Runmei; Li Lulu; Yin LeiLiu JingjingXu WeiyiCao WeiweiChen Zhong

首页> 外文期刊>International journal on Semantic Web and information systems >Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism

【24h】

Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism

机译：Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism

获取原文

获取原文并翻译 | 示例

获取外文期刊封面封底 >>

开具论文收录证明 >>

文献代查 >>

页面导航

摘要
著录项
相关主题

摘要

For Chinese NER tasks, there is very little annotation data available. To increase the dataset, improve the accuracy of Chinese NER task, and improve the model's stability, the authors propose a method to add local adversarial training to the transfer learning model and integrate the attention mechanism. The model uses ALBERT for migration pre-training and adds perturbation factors to the output matrix of the embedding layer to constitute local adversarial training. BILSTM is used to encode the shared and private features of the task, and the attention mechanism is introduced to capture the characters that focus more on the entities. Finally, the best entity annotation is obtained by CRF. Experiments are conducted on People's Daily 2004 and Tsinghua University open-source text classification datasets. The experimental results show that compared with the SOTA model, the F1 values of the proposed method in this paper are improved by 7.32 and 7.98 in the two different datasets, respectively, proving that the accuracy of the method in this paper is improved in the Chinese domain.

著录项

来源
《International journal on Semantic Web and information systems》 |2022年第1期|共20页
作者
Zhang Runmei; Li Lulu; Yin LeiLiu JingjingXu WeiyiCao WeiweiChen Zhong;
展开▼
作者单位

Anhui Jianzhu Univ;

Key Lab Flight Techn & Flight Safety;

展开▼
收录信息
原文格式 PDF
正文语种英语
中图分类计算机网络;
关键词
Albert; BiLSTM-CRF; Chinese Named Entity Recognition; Deep Learning; Transfer Learning;

Chinese Named Entity Recognition Method Combining ALBERT and a Local Adversarial Training and Adding Attention Mechanism

摘要

著录项

相关主题

期刊订阅