FacadeNet: Conditional Facade Synthesis via Selective Editing
Not on the map. Why?
Abstract (arXiv)
We introduce FacadeNet, a deep learning approach for synthesizing building facade images from diverse viewpoints. Our method employs a conditional GAN, taking a single view of a facade along with the desired viewpoint information and generates an image of the facade from the distinct viewpoint. To precisely modify view-dependent elements like windows and doors while preserving the structure of view-independent components such as walls, we introduce a selective editing module. This module leverages image embeddings extracted from a pre-trained vision transformer. Our experiments demonstrated state-of-the-art performance on building facade generation, surpassing alternative methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 2 Nov 2023.
Builds on
33 of 58 references.
References · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
21 more
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
- 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
- 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
- 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
- 2016Invertible Conditional GANs for image editingcited by 118
- 20233D generation on ImageNetcited by 47
Built on by
Not cited yet.