# Non-Adversarial Image Synthesis with Generative Latent Nearest Neighbors

arXiv: https://arxiv.org/abs/1812.08985 · HTML: https://mlsanity.com/paper/1812.08985/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 21 Dec 2018.

## Built on by (most cited first, 19 of 19)

- [Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer](https://mlsanity.com/paper/2203.13248/) (2022)
- [Green Learning: Introduction, Examples and Outlook](https://mlsanity.com/paper/2210.00965/) (2022)
- [You Only Sample Once: Taming One-Step Text-to-Image Synthesis by Self-Cooperative Diffusion GANs](https://mlsanity.com/paper/2403.12931/) (2024)
- [Unsupervised Image Representation Learning with Deep Latent Particles](https://mlsanity.com/paper/2205.15821/) (2022)
- [DDLP: Unsupervised Object-Centric Video Prediction with Deep Dynamic Latent Particles](https://mlsanity.com/paper/2306.05957/) (2023)
- [Unsupervised Image-to-Image Translation with Generative Prior](https://mlsanity.com/paper/2204.03641/) (2022)
- [Latent Particle World Models: Self-supervised Object-centric Stochastic Dynamics Modeling](https://mlsanity.com/paper/2603.04553/) (2026)
- [GP-UNIT: Generative Prior for Versatile Unsupervised Image-to-Image Translation](https://mlsanity.com/paper/2306.04636/) (2023)
- [StEP: Style-based Encoder Pre-training for Multi-modal Image Synthesis](https://mlsanity.com/paper/2104.07098/) (2021)
- [SAIC: Integration of Speech Anonymization and Identity Classification](https://mlsanity.com/paper/2312.15190/) (2023)
- [Hybrid Deep Learning Model using SPCAGAN Augmentation for Insider Threat Analysis](https://mlsanity.com/paper/2203.02855/) (2022)
- [Diverse Imitation Learning via Self-Organizing Generative Models](https://mlsanity.com/paper/2205.03484/) (2022)
- [PAGER: Progressive Attribute-Guided Extendable Robust Image Generation](https://mlsanity.com/paper/2206.00162/) (2022)
- [GENHOP: An Image Generation Method Based on Successive Subspace Learning](https://mlsanity.com/paper/2210.03689/) (2022)
- [OT-Net: A Reusable Neural Optimal Transport Solver](https://mlsanity.com/paper/2306.08233/) (2023)
- [Exploiting the Hidden Tasks of GANs: Making Implicit Subproblems Explicit](https://mlsanity.com/paper/2101.11863/) (2021)
- [Hybrid Generative Models for Two-Dimensional Datasets](https://mlsanity.com/paper/2106.00203/) (2021)
- [Conditioning Generative Latent Optimization for Sparse-View CT Image Reconstruction](https://mlsanity.com/paper/2307.16670/) (2023)
- [ParticleSplat: Self-supervised Object-centric Latent Particle Splatting](https://mlsanity.com/paper/2609.19463/) (2026)

## Abstract (arXiv)

Unconditional image generation has recently been dominated by generative adversarial networks (GANs). GAN methods train a generator which regresses images from random noise vectors, as well as a discriminator that attempts to differentiate between the generated images and a training set of real images. GANs have shown amazing results at generating realistic looking images. Despite their success, GANs suffer from critical drawbacks including: unstable training and mode-dropping. The weaknesses in GANs have motivated research into alternatives including: variational auto-encoders (VAEs), latent embedding learning methods (e.g. GLO) and nearest-neighbor based implicit maximum likelihood estimation (IMLE). Unfortunately at the moment, GANs still significantly outperform the alternative methods for image generation. In this work, we present a novel method - Generative Latent Nearest Neighbors (GLANN) - for training generative models without adversarial training. GLANN combines the strengths of IMLE and GLO in a way that overcomes the main drawbacks of each method. Consequently, GLANN generates images that are far better than GLO and IMLE. Our method does not suffer from mode collapse which plagues GAN training and is much more stable. Qualitative results show that GLANN outperforms a baseline consisting of 800 GANs and VAEs on commonly used datasets. Our models are also shown to be effective for training truly non-adversarial unsupervised image translation.