Optimizing the Latent Space of Generative Networks
Not on the map. Why?
Abstract (arXiv)
Generative Adversarial Networks (GANs) have achieved remarkable results in the task of generating realistic natural images. In most successful applications, GAN models share two common aspects: solving a challenging saddle point optimization problem, interpreted as an adversarial game between a generator and a discriminator functions; and parameterizing the generator and the discriminator as deep convolutional neural networks. The goal of this paper is to disentangle the contribution of these two factors to the success of GANs. In particular, we introduce Generative Latent Optimization (GLO), a framework to train deep convolutional generators using simple reconstruction losses. Throughout a variety of experiments, we show that GLO enjoys many of the desirable properties of GANs: synthesizing visually-appealing samples, interpolating meaningfully between samples, and performing linear arithmetic with noise vectors; all of this without the adversarial optimization scheme.
Key facts. Cited by 157 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 39; 2022: 29; 2023: 36; 2024: 26; 2025: 12; 2026: 15.
157 papers.
Sort:
By area:
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2021GAN Inversion: A Surveycited by 367
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
38 more
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
- 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 158
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
- 2021Fair Mixup: Fairness via Interpolationcited by 109
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 91
- 2021LOLNeRF: Learn from One Lookcited by 84
- 2021Differentiable Quality Diversitycited by 72
- 2022DP-NeRF: Deblurred Neural Radiance Field with Physical Scene Priorscited by 70
- 2022AutoRF: Learning 3D Object Radiance Fields from Single View Observationscited by 59
- 2023Representing Volumetric Videos as Dynamic MLP Mapscited by 51
- 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
- 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
- 2021Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetrycited by 47
- 2023Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Modelscited by 40
- 2021Point-Based Modeling of Human Clothingcited by 37
- 2023Preface: A Data-driven Volumetric Prior for Few-shot Ultra High-resolution Face Synthesiscited by 37
- 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
- 2021Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translationcited by 35
- 2021ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolationcited by 35
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2021Geometric Entropic Explorationcited by 32
- 2021SoftHebb: Bayesian Inference in Unsupervised Hebbian Soft Winner-Take-All Networkscited by 30
- 2021Occlusion-Aware Video Object Inpaintingcited by 30
- 2022Green Learning: Introduction, Examples and Outlookcited by 30
- 2024Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenescited by 30
- 2022SPAGHETTI: Editing Implicit Shapes Through Part Aware Generationcited by 28
- 2023TriHuman : A Real-time and Controllable Tri-plane Representation for Detailed Human Geometry and Appearance Synthesiscited by 28
- 2024Bilateral Guided Radiance Field Processingcited by 28
- 2022MyStyle: A Personalized Generative Priorcited by 26
- 2022NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera Localizationcited by 26
- 2021This Person (Probably) Exists. Identity Membership Attacks Against GAN Generated Facescited by 25
- 2024DS-NeRV: Implicit Neural Video Representation with Decomposed Static and Dynamic Codescited by 25
- 2021Bayesian Imaging With Data-Driven Priors Encoded by Neural Networks: Theory, Methods, and Algorithmscited by 24
- 2021Graph Neural Networks Based Detection of Stealth False Data Injection Attacks in Smart Gridscited by 24
- 2023Gaussian3Diff: 3D Gaussian Diffusion for 3D Full Head Synthesis and Editingcited by 22
50 most cited of 157 All 157 (JSON)
- 2026Downside-Controlled Online Forecast Combination under Delayed and Revised Outcomes24 Sep 2026
- 2026Kinks vs. Smoothness: Identifiability of Real Analytic nICA for Laplace-like Sources18 Sep 2026
- 2026Dynamic Learning Solutions: A System for Personalized Educational Video Generation13 Sep 2026
- 2026Towards unsupervised representation learning for quantum data: quantum models with inference and generation31 Aug 2026
- 2026Casting the Net! Revisiting MasterFace Impersonation Attacks7 Aug 2026
- 2026Soft-Constrained Optimization of Latent Space in Variational Autoencoders26 Jul 2026
- 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space13 Jul 2026
- 2026Cohort-Scale Neural Atlases of Ultrasound Video30 May 2026
- 2026Predicting 3D structure by latent posterior sampling11 May 2026
- 2026RehearsalNeRF: Decoupling Intrinsic Neural Fields of Dynamic Illuminations for Scene Editing30 Mar 2026
- 2026Q-BIOLAT: Binary Latent Protein Fitness Landscapes for QUBO-Based Optimization29 Mar 2026
- 2026Confidence-Based Mesh Extraction from 3D Gaussians25 Mar 2026
38 more
- 2026High-Fidelity Compression of Seismic Velocity Models via SIREN Auto-Decoders15 Mar 2026
- 2026Shape-informed cardiac mechanics surrogates in data-scarce regimes via geometric encoding and generative augmentation23 Feb 2026
- 2026X-Mark: Saliency-Guided Robust Dataset Ownership Verification for Medical Imaging10 Feb 2026
- 2025InfoMotion: A Graph-Based Approach to Video Dataset Distillation for Echocardiography10 Dec 2025
- 2025Structure-Preserving Unpaired Image Translation to Photometrically Calibrate JunoCam with Hubble Data27 Nov 2025
- 2025Conditional neural field for spatial dimension reduction of turbulence data: a comparison study29 Oct 2025
- 2025ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Training13 Oct 2025
- 2025ImHead: A Large-scale Implicit Morphable Model for Localized Head Modeling12 Oct 2025
- 2025Learning Neural Exposure Fields for View Synthesis9 Oct 2025
- 2025Engineering Sentience25 Jun 2025
- 2025Real-Time Network Traffic Forecasting with Missing Data: A Generative Model Approach11 Jun 2025
- 2025Deep Kernel Bayesian Optimisation for Closed-Loop Electrode Microstructure Design with User-Defined Properties based on GANs7 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025Training Latent Diffusion Models with Interacting Particle Algorithms18 May 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2024Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variation19 Dec 2024
- 2024SimVS: Simulating World Inconsistencies for Robust View Synthesis10 Dec 2024
- 2024Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenes2 Dec 2024
- 2024DeSplat: Decomposed Gaussian Splatting for Distractor-Free Rendering29 Nov 2024
- 2024VAIR: Visuo-Acoustic Implicit Representations for Low-Cost, Multi-Modal Transparent Surface Reconstruction in Indoor Scenes7 Nov 2024
- 2024InvSeg: Test-Time Prompt Inversion for Semantic Segmentation15 Oct 2024
- 2024Deep Linear Probe Generators for Weight Space Learning14 Oct 2024
- 2024Posterior sampling via Langevin dynamics based on generative priors2 Oct 2024
- 2024Empowering Sign Language Communication: Integrating Sentiment and Semantics for Facial Expression Synthesis27 Aug 2024
- 2024Graph Clustering with Cross-View Feature Propagation12 Aug 2024
- 2024Accelerating Learned Video Compression via Low-Resolution Representation Learning23 Jul 2024
- 2024ChatSR: Multimodal Large Language Models for Scientific Formula Discovery8 Jun 2024
- 2024Deep Learning-based Cross-modal Reconstruction of Vehicle Target from Sparse 3D SAR Image6 Jun 2024
- 2024Bilateral Guided Radiance Field Processing1 Jun 2024
- 2024FUSE: Fast Unified Simulation and Estimation for PDEs23 May 2024
- 2024Gaussian Time Machine: A Real-Time Rendering Methodology for Time-Variant Appearances22 May 2024
- 2024Generative Pre-Trained Transformer for Symbolic Regression Base In-Context Reinforcement Learning9 Apr 2024
- 2024MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space1 Apr 2024
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians26 Mar 2024
- 2024DS-NeRV: Implicit Neural Video Representation with Decomposed Static and Dynamic Codes23 Mar 2024
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS20 Mar 2024
- 2024Learning Novel View Synthesis from Heterogeneous Low-light Captures20 Mar 2024
- 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstruction27 Feb 2024
50 newest of 157 All 157 (JSON)
- 2023AutoDecoding Latent 3D Diffusion Modelscited by 50
- 2023Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Modelscited by 40
- 2025Training Latent Diffusion Models with Interacting Particle Algorithmscited by 4
- 2021Differentiable Gaussianization Layers for Inverse Problems Regularized by Deep Generative Modelscited by 3
- 2024InvSeg: Test-Time Prompt Inversion for Semantic Segmentationcited by 2
- 2026Predicting 3D structure by latent posterior samplingcited by 1
- 2026Predicting 3D structure by latent posterior sampling11 May 2026
- 2025Training Latent Diffusion Models with Interacting Particle Algorithms18 May 2025
- 2024InvSeg: Test-Time Prompt Inversion for Semantic Segmentation15 Oct 2024
- 2023Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Models19 Dec 2023
- 2023AutoDecoding Latent 3D Diffusion Models7 Jul 2023
- 2021Differentiable Gaussianization Layers for Inverse Problems Regularized by Deep Generative Models7 Dec 2021
- 2024Deep Linear Probe Generators for Weight Space Learningcited by 17
- 2024Deep Linear Probe Generators for Weight Space Learning14 Oct 2024
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2021GAN Inversion: A Surveycited by 367
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 230
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
12 most cited of 141 All 141 (JSON)
- 2026Downside-Controlled Online Forecast Combination under Delayed and Revised Outcomes24 Sep 2026
- 2026Kinks vs. Smoothness: Identifiability of Real Analytic nICA for Laplace-like Sources18 Sep 2026
- 2026Towards unsupervised representation learning for quantum data: quantum models with inference and generation31 Aug 2026
- 2026Casting the Net! Revisiting MasterFace Impersonation Attacks7 Aug 2026
- 2026Soft-Constrained Optimization of Latent Space in Variational Autoencoders26 Jul 2026
- 2026Cohort-Scale Neural Atlases of Ultrasound Video30 May 2026
- 2026RehearsalNeRF: Decoupling Intrinsic Neural Fields of Dynamic Illuminations for Scene Editing30 Mar 2026
- 2026Q-BIOLAT: Binary Latent Protein Fitness Landscapes for QUBO-Based Optimization29 Mar 2026
- 2026Confidence-Based Mesh Extraction from 3D Gaussians25 Mar 2026
- 2026High-Fidelity Compression of Seismic Velocity Models via SIREN Auto-Decoders15 Mar 2026
- 2026Shape-informed cardiac mechanics surrogates in data-scarce regimes via geometric encoding and generative augmentation23 Feb 2026
- 2025InfoMotion: A Graph-Based Approach to Video Dataset Distillation for Echocardiography10 Dec 2025
12 newest of 141 All 141 (JSON)