首页> 外文期刊>Neural Networks and Learning Systems, IEEE Transactions on >Efficient Training of Supervised Spiking Neural Network via Accurate Synaptic-Efficiency Adjustment Method
【24h】

Efficient Training of Supervised Spiking Neural Network via Accurate Synaptic-Efficiency Adjustment Method

机译:通过精确的突触效率调整方法对有监督的尖刺神经网络进行有效训练

获取原文
获取原文并翻译 | 示例
           

摘要

The spiking neural network (SNN) is the third generation of neural networks and performs remarkably well in cognitive tasks, such as pattern recognition. The temporal neural encode mechanism found in biological hippocampus enables SNN to possess more powerful computation capability than networks with other encoding schemes. However, this temporal encoding approach requires neurons to process information serially on time, which reduces learning efficiency significantly. To keep the powerful computation capability of the temporal encoding mechanism and to overcome its low efficiency in the training of SNNs, a new training algorithm, the accurate synaptic-efficiency adjustment method is proposed in this paper. Inspired by the selective attention mechanism of the primate visual system, our algorithm selects only the target spike time as attention areas, and ignores voltage states of the untarget ones, resulting in a significant reduction of training time. Besides, our algorithm employs a cost function based on the voltage difference between the potential of the output neuron and the firing threshold of the SNN, instead of the traditional precise firing time distance. A normalized spike-timing-dependent-plasticity learning window is applied to assigning this error to different synapses for instructing their training. Comprehensive simulations are conducted to investigate the learning properties of our algorithm, with input neurons emitting both single spike and multiple spikes. Simulation results indicate that our algorithm possesses higher learning performance than the existing other methods and achieves the state-of-the-art efficiency in the training of SNN.
机译:尖峰神经网络(SNN)是第三代神经网络,在认知任务(例如模式识别)中表现出色。在生物海马体中发现的时间神经编码机制使SNN拥有比具有其他编码方案的网络更强大的计算能力。但是,这种时间编码方法要求神经元按时连续处理信息,这大大降低了学习效率。为了保持时间编码机制强大的计算能力,并克服其在SNN训练中的低效率,提出了一种新的训练算法,即精确的突触效率调整方法。受灵长类视觉系统选择性注意机制的启发,我们的算法仅选择目标尖峰时间作为关注区域,而忽略了非目标尖峰时间的电压状态,从而大大减少了训练时间。此外,我们的算法采用了基于输出神经元电位与SNN触发阈值之间的电压差的代价函数,而不是传统的精确触发时间距离。归一化的与穗期相关的可塑性学习窗口被应用来将该误差分配给不同的突触,以指导其训练。进行了全面的仿真以研究我们算法的学习特性,其中输入神经元同时发出单个峰值和多个峰值。仿真结果表明,我们的算法比现有的其他方法具有更高的学习性能,并且在SNN训练中达到了最新的效率。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号