首页>
外国专利>
Methods, devices, devices and storage media for acquiring word vectors based on language models
Methods, devices, devices and storage media for acquiring word vectors based on language models
展开▼
机译:用于基于语言模型获取字向量的方法,设备,设备和存储介质
展开▼
页面导航
摘要
著录项
相似文献
摘要
PROBLEM TO BE SOLVED: To provide a method for avoiding the risk of information leakage due to learning based on character particle size, enhancing the learning ability of word meaning information by a language model, accelerating the convergence speed of a word vector, and enhancing the training effect. SOLUTION: The method inputs each of at least two first sample text language materials into a language model, outputs a context vector of a first word mask in each said first sample text language material by the language model, and first. The word vector corresponding to each of the first word masks is determined based on the word vector parameter matrix, the second word vector parameter matrix, and the fully connected matrix, respectively, and corresponds to the first word mask in at least two first sample text language materials. Based on the word vector to be used, the language model and the fully connected matrix are trained to obtain the word vector. [Selection diagram] Fig. 1
展开▼