首页>
外国专利>
TRAINING A NEURAL NETWORK USING PERIODIC SAMPLING OVER MODEL WEIGHTS
TRAINING A NEURAL NETWORK USING PERIODIC SAMPLING OVER MODEL WEIGHTS
展开▼
机译：使用定期抽样培训一个神经网络，通过模型重量
展开▼
页面导航
摘要
著录项
相似文献
摘要
A computer-implemented method includes: initializing model parameters for training a neural network; performing a forward pass and backpropagation for a first minibatch of training data; determining a new weight value for each of a plurality of nodes of the neural network using a gradient descent of the first minibatch; for each determined new weight value, determining whether to update a running mean corresponding to a weight of a particular node; based on a determination to update the running mean, calculating a new mean weight value for the particular node using the determined new weight value; updating the weight parameters for all nodes based on the calculated new mean weight values corresponding to each node; assigning the running mean as the weight for the particular node when training on the first minibatch is completed; and reinitializing running means for all nodes at a start of training a second minibatch.
展开▼
