首页>
外国专利>
METHOD AND APPARATUS FOR IMPROVING MODEL BASED ON PRE-TRAINED SEMANTIC MODEL
METHOD AND APPARATUS FOR IMPROVING MODEL BASED ON PRE-TRAINED SEMANTIC MODEL
展开▼
机译:基于预训练的语义模型改进模型的方法和装置
展开▼
页面导航
摘要
著录项
相似文献
摘要
The present disclosure provides a method and apparatus for improving a model based on a pre-trained semantic model, and relates to the technical fields of natural language processing and deep learning. A specific implementation solution is: based on the pre-trained semantic model, obtaining an initial improved model, where semantic result information of an input vector is determined in the initial improved model based on a hash search method; and based on a model distillation method, training the initial improved model to obtain an improved model. This solution obtains the semantic result information of the input vector by performing the hash search method on the input vector, replaces the original complex iterative calculation process of a semantic model, obtains the improved model with few model parameters and high compression ratio, and improves the processing speed of the improved model.
展开▼