首页> 外文OA文献 >Heterogeneous probabilistic models for optimisation and modelling of evolving spiking neural networks
【2h】

Heterogeneous probabilistic models for optimisation and modelling of evolving spiking neural networks

机译:用于优化和建模演化尖峰神经网络的异构概率模型

摘要

This thesis proposes a novel feature selection and classification method employing evolving spiking neural networks (eSNN) and evolutionary algorithms (EA). The method is named the Quantum-inspired Spiking Neural Network (QiSNN) framework. QiSNN represents an integrated wrapper approach. An evolutionary process evolves appropriate feature subsets for a given classification task and simultaneously optimises the neural and learning-related parameters of the network. Unlike other methods, the connection weights of this network are determined by a fast one-pass learning algorithm which dramatically reduces the training time. In its core, QiSNN employs the Thorpe neural model that allows the efficient simulation of even large networks. In QiSNN, the presence or absence of features is represented by a string of concatenated bits, while the parameters of the neural network are continuous. For the exploration of these two entirely different search spaces, a novel Estimation of Distribution Algorithm (EDA) is developed. The method maintains a population of probabilistic models specialised for the optimisation of either binary, continuous or heterogeneous search spaces while utilising a small and intuitive set of parameters. The EDA extends the Quantum-inspired Evolutionary Algorithm (QEA) proposed by Han and Kim (2002) and was named the Heterogeneous Hierarchical Model EDA (hHM-EDA). The algorithm is compared to numerous contemporary optimisation methods and studied in terms of convergence speed, solution quality and robustness in noisy search spaces. The thesis investigates the functioning and the characteristics of QiSNN using both synthetic feature selection benchmarks and a real-world case study on ecological modelling. By evolving suitable feature subsets, QiSNN significantly enhances the classification accuracy of eSNN. Compared to numerous other feature selection techniques, like the wrapper-based Multilayer Perceptron (MLP) and the Naive Bayesian Classifier (NBC), QiSNN demonstrates a competitive classification and feature selection performance while requiring comparatively low computational costs.
机译:本文提出了一种基于进化尖峰神经网络(eSNN)和进化算法(EA)的特征选择和分类方法。该方法被称为量子启发性尖峰神经网络(QiSNN)框架。 QiSNN代表一种集成的包装方法。演化过程为给定的分类任务演化出适当的特征子集,并同时优化网络的神经和学习相关参数。与其他方法不同,此网络的连接权重由快速的一次遍历学习算法确定,该算法大大减少了训练时间。 QiSNN的核心是采用Thorpe神经模型,该模型可以对大型网络进行有效仿真。在QiSNN中,特征的存在或不存在由一连串的位表示,而神经网络的参数是连续的。为了探索这两个完全不同的搜索空间,开发了一种新颖的分布算法估计(EDA)。该方法维护了大量概率模型,这些概率模型专用于优化二元,连续或异构搜索空间,同时利用少量直观的参数集。 EDA扩展了Han和Kim(2002)提出的量子启发演化算法(QEA),并被称为异构层次模型EDA(hHM-EDA)。该算法与众多现代优化方法进行了比较,并在嘈杂搜索空间中的收敛速度,解质量和鲁棒性方面进行了研究。本文使用综合特征选择基准和生态建模的实际案例研究了QiSNN的功能和特性。通过演化合适的特征子集,QiSNN大大提高了eSNN的分类准确性。与众多其他特征选择技术(例如基于包装的多层感知器(MLP)和朴素贝叶斯分类器(NBC))相比,QiSNN展示了具有竞争力的分类和特征选择性能,同时需要相对较低的计算成本。

著录项

  • 作者

    Schliebs Stefan;

  • 作者单位
  • 年度 2010
  • 总页数
  • 原文格式 PDF
  • 正文语种 en
  • 中图分类

相似文献

  • 外文文献
  • 中文文献
  • 专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号