Accelerating deep neural network training with inconsistent stochastic gradient descent

• 1. 一种加速分布式深度神经网络训练的混合流水线并行方法 [P] . 中国专利： CN112784968A . 2021-05-11
• 2. 一种加速分布式深度神经网络的训练方法及装置 [P] . 中国专利： CN108876702A . 2018-11-23
• 3. ACCELERATING DEEP NEURAL NETWORK TRAINING WITH INCONSISTENT STOCHASTIC GRADIENT DESCENT [P] . 美国专利： US2017228645A1 . 2017-08-10

  机译： 随机梯度下降的加速深层神经网络训练

• 4. ACCELERATING DEEP NEURAL NETWORK TRAINING WITH INCONSISTENT STOCHASTIC GRADIENT DESCENT [P] . 世界知识产权组织专利： WO2017136802A1 . 2017-08-10

  机译： 随机梯度下降的加速深层神经网络训练

• 5. Speeding up training of deep neural networks using inconsistent stochastic gradient descent [P] . 日本专利： JP2019509550A . 2019-04-04

  机译： 使用不一致的随机梯度下降加速深层神经网络的训练

• 1. CONVERGENCE OF ONLINE GRADIENT METHOD WITH A PENALTY TERM FOR FEEDFORWARD NEURAL NETWORKS WITH STOCHASTIC INPUTS [J] . Shao Hongmei, Wu Wei, Li Feng 高等学校计算数学学报（英文版） . 2005,第001期
• 2. Comparative study of multilayer perceptron-stochastic gradient descent and gradient boosted trees for predicting daily suspended sediment load: The case study of the Mississippi River, U.S. [J] . Sadra Shadkani, Akram Abbaspour, Saeed Samadianfard, 国际泥沙研究（英文版） . 2021,第004期
• 3. DSNNs:learning transfer from deep neural networks to spiking neural networks [J] . Zhang Lei, Du Zidong, Li Ling, 高技术通讯（英文版） . 2020,第002期
• 4. Accelerating deep neural network training with inconsistent stochastic gradient descent [J] . Wang Linnan, Yang Yi, Min Renqiang, Neural Networks: The Official Journal of the International Neural Network Society . 2017,第期
• 5. Non-convergence of stochastic gradient descent in the training of deep neural networks [J] . Cheridito Patrick, Jentzen Arnulf, Rossmannek Florian Journal of complexity . 2021,第Juna期
• 6. Stochastic Gradient Descent–Whale Optimization Algorithm-Based Deep Convolutional Neural Network To Crowd Emotion Understanding [J] . Avinash Ratre The Computer journal . 2020,第2CD期
• 7. Improving training time of deep neural networkwith asynchronous averaged stochastic gradient descent [C] . You Zhao, Xu Bo International Symposium on Chinese Spoken Language Processing . 2014
• 8. An Investigation of Stochastic Gradient Descent Dynamics of Neural Networks [D] . Luo, Victor. 2021
• 9. Mutual Information Based Learning Rate Decay for Stochastic Gradient Descent Training of Deep Neural Networks [O] . Shrihari Vasudevan 2020
• 10. Accelerating Deep Neural Network Training with Inconsistent Stochastic Gradient Descent [O] . Wang, Linnan, Yang, Yi, Min, Martin Renqiang, 2017

• 1. Towards high performance low bitwidth training for deep neural networks [J] . Chunyou Su ,Sheng Zhou ,Liang Feng . 半导体学报：英文版 . 2020,第2期
• 2. Towards efficient deep neural network training by FPGA-based batch-level parallelism [J] . Cheng Luo ,Man-Kit Sit ,Hongxiang Fan . 半导体学报：英文版 . 2020,第2期
• 3. 深度神经网络压缩和加速方法综述 [C] . 姜春晖 ,钱超 . 智能时代的创新、融合与发展——2018全国博士后学术交流会 . 2018
• 4. 深度神经网络数据并行训练加速策略研究 [A] . 叶俊贤 . 2020