mlsanityData to 7 Oct 2026

RetrieveGAN: Image Synthesis via Differentiable Patch Retrieval

arXiv 2007.08513 ↗First posted 16 Jul 2020cs.CVcited by 35

Not on the map. Why?

Abstract (arXiv)

Image generation from scene description is a cornerstone technique for the controlled generation, which is beneficial to applications such as content creation and image editing. In this work, we aim to synthesize images from scene description with retrieved patches as reference. We propose a differentiable retrieval module. With the differentiable retrieval module, we can (1) make the entire pipeline end-to-end trainable, enabling the learning of better feature embedding for retrieval; (2) encourage the selection of mutually compatible patches with additional objective functions. We conduct extensive quantitative and qualitative experiments to demonstrate that the proposed method can generate realistic and diverse images, where the retrieved patches are reasonable and mutually compatible.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jul 2020.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 11; 2022: 11; 2023: 5; 2024: 5; 2025: 3.

35 papers.

Sort:

By area:

  1. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  2. 2022KNN-Diffusion: Image Generation via Large-Scale Retrievalcited by 135
  3. 2021Regularizing Generative Adversarial Networks under Limited Datacited by 105
  4. 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
  5. 2022Make-A-Story: Visual Memory Conditioned Consistent Story Generationcited by 76
  6. 2021Enhancing Photorealism Enhancementcited by 74
  7. 2021Learning of Visual Relations: The Devil is in the Tailscited by 65
  8. 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Modelscited by 63
  9. 2021Improving Text-to-Image Synthesis Using Contrastive Learningcited by 62
  10. 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
  11. 2022Retrieval-based Controllable Molecule Generationcited by 44
  12. 2023Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Modelscited by 40
23 more
  1. 2022Semi-Parametric Neural Image Synthesiscited by 36
  2. 2021Exploiting Long-Term Dependencies for Generating Dynamic Scene Graphscited by 30
  3. 2022Probabilistic Compositional Embeddings for Multimodal Image Retrievalcited by 29
  4. 2021RetrievalFuse: Neural 3D Scene Reconstruction with a Databasecited by 28
  5. 2022Memories are One-to-Many Mapping Alleviators in Talking Face Generationcited by 22
  6. 2024Retrieval-Augmented Open-Vocabulary Object Detectioncited by 20
  7. 2022Vector Quantized Image-to-Image Translationcited by 16
  8. 2024Retrieval-Augmented Score Distillation for Text-to-3D Generationcited by 14
  9. 2022Retrieval Based Time Series Forecastingcited by 13
  10. 2022Memory-Driven Text-to-Image Generationcited by 10
  11. 2024Nearest Neighbour Score Estimators for Diffusion Generative Modelscited by 10
  12. 2024RAGDiffusion: Faithful Cloth Generation via External Knowledge Assimilationcited by 9
  13. 2021Decorating Your Own Bedroom: Locally Controlling Image Generation with Generative Adversarial Networkscited by 8
  14. 2022PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformationcited by 7
  15. 2023Single-Stage Visual Relationship Learning using Conditional Queriescited by 7
  16. 2023Controllable Image Generation via Collage Representationscited by 5
  17. 2025RAGME: Retrieval Augmented Video Generation for Enhanced Motion Realismcited by 4
  18. 2021Remember What You have drawn: Semantic Image Manipulation with Memorycited by 3
  19. 2023FIANCEE: Faster Inference of Adversarial Networks via Conditional Early Exitscited by 3
  20. 2025LayoutRAG: Retrieval-Augmented Model for Content-agnostic Conditional Layout Generationcited by 3
  21. 2021MixSyn: Learning Composition and Style for Multi-Source Image Synthesiscited by 2
  22. 2025TrackingMiM: Efficient Mamba-in-Mamba Serialization for Real-time UAV Object Trackingcited by 1
  23. 2023Semantically-aware Mask CycleGAN for Translating Artistic Portraits to Photo-realistic Visualizationscited by 0