首页> 外文期刊>IFAC PapersOnLine >A Pruning Method Based on Weight Variation Information for Feedforward Neural Networks
【24h】

A Pruning Method Based on Weight Variation Information for Feedforward Neural Networks

机译:基于权重变化信息的前馈神经网络修剪方法

获取原文
           

摘要

Artificial neural networks are powerful tools for many information processing tasks such as pattern recognition, data mining, optimization, and prediction. It is a significant problem to find optimal structures of artificial neural networks for drawing out their high computational performance. Downsizing of network structure is also an issue to be considered for hardware implementation of large-scale neural networks. In this study, we propose a pruning method to find a compact structure of feedforward neural networks with high generalization ability in classification problems. Our method evaluates the significance of neuron nodes using the information on weight variation in the training process and prune the insignificant nodes preferentially unless the classification accuracy is degraded. Numerical experiments with several benchmark datasets show that the proposed method is effective compared with other methods.
机译:人工神经网络是用于许多信息处理任务(例如模式识别,数据挖掘,优化和预测)的强大工具。寻找人工神经网络的最佳结构以发挥其高计算性能是一个重大问题。网络结构的小型化也是大规模神经网络的硬件实现要考虑的问题。在这项研究中,我们提出了一种修剪方法,以在分类问题中找到具有高泛化能力的前馈神经网络的紧凑结构。我们的方法在训练过程中使用有关权重变化的信息来评估神经元节点的重要性,并优先修剪那些无关紧要的节点,除非分类精度降低。多个基准数据集的数值实验表明,与其他方法相比,该方法是有效的。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号