首页> 外文期刊>Neural Networks and Learning Systems, IEEE Transactions on >A Multiobjective Sparse Feature Learning Model for Deep Neural Networks
【24h】

A Multiobjective Sparse Feature Learning Model for Deep Neural Networks

机译:深度神经网络的多目标稀疏特征学习模型

获取原文
获取原文并翻译 | 示例
           

摘要

Hierarchical deep neural networks are currently popular learning models for imitating the hierarchical architecture of human brain. Single-layer feature extractors are the bricks to build deep networks. Sparse feature learning models are popular models that can learn useful representations. But most of those models need a user-defined constant to control the sparsity of representations. In this paper, we propose a multiobjective sparse feature learning model based on the autoencoder. The parameters of the model are learnt by optimizing two objectives, reconstruction error and the sparsity of hidden units simultaneously to find a reasonable compromise between them automatically. We design a multiobjective induced learning procedure for this model based on a multiobjective evolutionary algorithm. In the experiments, we demonstrate that the learning procedure is effective, and the proposed multiobjective model can learn useful sparse features.
机译:分层深度神经网络是当前流行的用于模仿人脑分层体系结构的学习模型。单层特征提取器是构建深度网络的基础。稀疏特征学习模型是可以学习有用表示的流行模型。但是这些模型中的大多数都需要一个用户定义的常数来控制表示的稀疏性。本文提出了一种基于自动编码器的多目标稀疏特征学习模型。通过同时优化两个目标(重构误差和隐藏单元的稀疏性)以自动找到它们之间的合理折衷,可以学习模型的参数。我们基于多目标进化算法为此模型设计了一个多目标诱导学习程序。在实验中,我们证明了学习过程是有效的,并且所提出的多目标模型可以学习有用的稀疏特征。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号