...
首页> 外文期刊>The Visual Computer >Stylistic scene enhancement GAN: mixed stylistic enhancement generation for 3D indoor scenes
【24h】

Stylistic scene enhancement GAN: mixed stylistic enhancement generation for 3D indoor scenes

机译:风格场景增强GAN:3D室内场景的混合风格增强生成

获取原文
获取原文并翻译 | 示例
           

摘要

In this paper, we present stylistic scene enhancement GAN, SSE-GAN, a conditional Wasserstein GAN-based approach to automatic generation of mixed stylistic enhancements for 3D indoor scenes. An enhancement indicates factors that can influence the style of an indoor scene such as furniture colors and occurrence of small objects. To facilitate network training, we propose a novel enhancement feature encoding method, which represents an enhancement by a multi-one-hot vector, and effectively accommodates different enhancement factors. A Gumbel-Softmax module is introduced in the generator network to enable the generation of high fidelity enhancement features that can better confuse the discriminator. Experiments show that our approach is superior to the other baseline methods and successfully models the relationship between the style distribution and scene enhancements. Thus, although only trained with a dataset of room images in single styles, the trained generator can generate mixed stylistic enhancements by specifying multiple styles as the condition. Our approach is the first to apply a Gumbel-Softmax module in conditional Wasserstein GANs, as well as the first to explore the application of GAN-based models in the scene enhancement field.
机译:在本文中,我们介绍了风格场景增强GAN,SSE-GAN,这是一种基于Wasserstein GAN的有条件方法,用于自动生成3D室内场景的混合风格增强。增强表示可能影响室内场景样式的因素,例如家具颜色和小物体的出现。为了促进网络训练,我们提出了一种新颖的增强特征编码方法,该方法表示多单热点矢量的增强,并有效地容纳了不同的增强因子。在生成器网络中引入了Gumbel-Softmax模块,以生成高保真度增强功能,这些功能可以更好地使鉴别符混淆。实验表明,我们的方法优于其他基准方法,并成功地建模了样式分布与场景增强之间的关系。因此,尽管仅使用单一样式的房间图像数据集进行训练,但是训练后的生成器可以通过将多种样式指定为条件来生成混合的样式增强。我们的方法是第一个在条件Wasserstein GAN中应用Gumbel-Softmax模块的方法,也是第一个探索基于GAN的模型在场景增强领域中的应用的方法。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号