首页> 外国专利> External word embedding neural network language models

External word embedding neural network language models

机译:外部词嵌入神经网络语言模型

摘要

A mechanism is provided in a data processing system for external word embedding neural network language models. The mechanism configures the data processing system with an external word embedding neural network language model that accepts as input a sequence of words and predicts a current word based on the sequence of words. The external word embedding neural network language model combines an external embedding matrix to a history word embedding matrix and a prediction word embedding matrix of the external word embedding neural network language model. The mechanism receives a sequence of input words by the data processing system. The mechanism applies a plurality of previous words in the sequence of input words as inputs to the external word embedding neural network language model. The external word embedding neural network language model generates a predicted current word based on the plurality of previous words. The mechanism processes a current word in the sequence of input words based on the predicted current word generated by the external word embedding neural network language model.
机译:在数据处理系统中提供了一种用于外部词嵌入神经网络语言模型的机制。该机制使用外部单词嵌入神经网络语言模型配置数据处理系统,该模型将输入单词序列并根据单词序列预测当前单词作为输入。外部词嵌入神经网络语言模型将外部词嵌入矩阵与外部词嵌入神经网络语言模型的历史词嵌入矩阵和预测词嵌入矩阵相结合。该机制由数据处理系统接收输入字序列。该机制将输入单词序列中的多个先前单词作为外部单词嵌入神经网络语言模型的输入。外部词嵌入神经网络语言模型基于多个先前词生成预测的当前词。该机制基于由外部词嵌入神经网络语言模型生成的预测当前词来处理输入词序列中的当前词。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号