首页> 外文会议>International Conference on Artificial Neural Networks >HiSeqGAN: Hierarchical Sequence Synthesis and Prediction
【24h】

HiSeqGAN: Hierarchical Sequence Synthesis and Prediction

机译:HiSeqGAN:层次序列合成和预测

获取原文

摘要

High-dimensional data sequences constantly appear in practice. State-of-the-art models such as recurrent neural networks suffer prediction accuracy from complex relations among values of attributes. Adopting unsupervised clustering that clusters data based on their attribute value similarity results data in lower dimensions that can be structured in a hierarchical relation. It is essential to consider these data relations to improve the performance of training models. In this work, we propose a new approach to synthesize and predict sequences of data that are structured in a hierarchy. Specifically, we adopt a new hierarchical data encoding and seamlessly modify loss functions of SeqGAN as our training model to synthesize data sequences. In practice, we first use the hierarchical clustering algorithm, GHSOM, to cluster our training data. By relabelling a sample with the cluster that it falls to, we are able to use the GHSOM map to identify the hierarchical relation of samples. We then converse the clusters to the coordinate vectors with our hierarchical data encoding algorithm and replace the loss function with maximizing cosine similarity in the SeqGAN model to synthesize cluster sequences. Using the synthesized sequences, we are able to achieve better performance on high-dimension data training and prediction compared to the state-of-the-art models.
机译:高维数据序列在实践中不断出现。最新的模型(例如递归神经网络)由于属性值之间的复杂关系而无法获得准确的预测。采用基于数据属性值相似性对数据进行聚类的无监督聚类,可以在较低维度上生成可以按层次关系进行结构化的数据。必须考虑这些数据关系以提高训练模型的性能。在这项工作中,我们提出了一种新的方法来合成和预测层次结构中的数据序列。具体来说,我们采用新的分层数据编码,并无缝修改SeqGAN的损失函数作为我们的训练模型以合成数据序列。在实践中,我们首先使用分层聚类算法GHSOM对我们的训练数据进行聚类。通过使用其所属的簇重新标记样本,我们可以使用GHSOM映射来识别样本的层次关系。然后,使用我们的分层数据编码算法将聚类转换为坐标向量,并用SeqGAN模型中的最大余弦相似度替换损失函数以合成聚类序列。与最新模型相比,使用合成序列,我们可以在高维数据训练和预测上实现更好的性能。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号