# Patch-Based Image Inpainting with Generative Adversarial Networks

arXiv: https://arxiv.org/abs/1803.07422 · HTML: https://mlsanity.com/paper/1803.07422/

## Key facts

- Cited by 70 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Mar 2018.

## Built on by (most cited first, 30 of 70)

- [Ovis: Structural Embedding Alignment for Multimodal Large Language Model](https://mlsanity.com/paper/2405.20797/) (2024)
- [Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyond](https://mlsanity.com/paper/2405.03520/) (2024)
- [Labels4Free: Unsupervised Segmentation using StyleGAN](https://mlsanity.com/paper/2103.14968/) (2021)
- [Guided Co-Modulated GAN for 360deg Field of View Extrapolation](https://mlsanity.com/paper/2204.07286/) (2022)
- [A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networks](https://mlsanity.com/paper/2105.13136/) (2021)
- [Position, Padding and Predictions: A Deeper Look at Position Information in CNNs](https://mlsanity.com/paper/2101.12322/) (2021)
- [MFAGAN: A Compression Framework for Memory-Efficient On-Device Super-Resolution GAN](https://mlsanity.com/paper/2107.12679/) (2021)
- [TaDiCodec: Text-aware Diffusion Speech Tokenizer for Speech Language Modeling](https://mlsanity.com/paper/2508.16790/) (2025)
- [Generative Adversarial Networks for Image Super-Resolution: A Survey](https://mlsanity.com/paper/2204.13620/) (2022)
- [Non-Imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive Survey](https://mlsanity.com/paper/2209.09239/) (2022)
- [Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild](https://mlsanity.com/paper/2209.00642/) (2022)
- [Vision + Language Applications: A Survey](https://mlsanity.com/paper/2305.14598/) (2023)
- [SDF-3DGAN: A 3D Object Generative Method Based on Implicit Signed Distance Function](https://mlsanity.com/paper/2303.06821/) (2023)
- [RPG-Palm: Realistic Pseudo-data Generation for Palmprint Recognition](https://mlsanity.com/paper/2307.14016/) (2023)
- [CoD-Lite: Real-Time Diffusion-Based Generative Image Compression](https://mlsanity.com/paper/2604.12525/) (2026)
- [Generative Adversarial Networks for Synthetic Data Generation: A Comparative Study](https://mlsanity.com/paper/2112.01925/) (2021)
- [CS2: A Controllable and Simultaneous Synthesizer of Images and Annotations with Minimal Human Intervention](https://mlsanity.com/paper/2206.13394/) (2022)
- [Reconstructing occluded Elevation Information in Terrain Maps with Self-supervised Learning](https://mlsanity.com/paper/2109.07150/) (2021)
- [Convolutional Neural Processes for Inpainting Satellite Images](https://mlsanity.com/paper/2205.12407/) (2022)
- [Rain Removal from Light Field Images with 4D Convolution and Multi-scale Gaussian Process](https://mlsanity.com/paper/2208.07735/) (2022)
- [PATMAT: Person Aware Tuning of Mask-Aware Transformer for Face Inpainting](https://mlsanity.com/paper/2304.06107/) (2023)
- [CryoGEM: Physics-Informed Generative Cryo-Electron Microscopy](https://mlsanity.com/paper/2312.02235/) (2023)
- [Zero-shot Text-guided Infinite Image Synthesis with LLM guidance](https://mlsanity.com/paper/2407.12642/) (2024)
- [HDL: Hybrid Deep Learning for the Synthesis of Myocardial Velocity Maps in Digital Twins for Cardiac Analysis](https://mlsanity.com/paper/2203.05564/) (2022)
- [BSDGAN: Balancing Sensor Data Generative Adversarial Networks for Human Activity Recognition](https://mlsanity.com/paper/2208.03647/) (2022)
- [Diverse Single Image Generation with Controllable Global Structure](https://mlsanity.com/paper/2102.04780/) (2021)
- [GMFIM: A Generative Mask-guided Facial Image Manipulation Model for Privacy Preservation](https://mlsanity.com/paper/2201.03353/) (2022)
- [Faster Diffusion Cardiac MRI with Deep Learning-based breath hold reduction](https://mlsanity.com/paper/2206.10543/) (2022)
- [Leveraging Activation Maximization and Generative Adversarial Training to Recognize and Explain Patterns in Natural Areas in Satellite Imagery](https://mlsanity.com/paper/2311.08923/) (2023)
- [Dynamic Appearance Modeling of Clothed 3D Human Avatars using a Single Camera](https://mlsanity.com/paper/2312.16842/) (2023)

## Abstract (arXiv)

Area of image inpainting over relatively large missing regions recently advanced substantially through adaptation of dedicated deep neural networks. However, current network solutions still introduce undesired artifacts and noise to the repaired regions. We present an image inpainting method that is based on the celebrated generative adversarial network (GAN) framework. The proposed PGGAN method includes a discriminator network that combines a global GAN (G-GAN) architecture with a patchGAN approach. PGGAN first shares network layers between G-GAN and patchGAN, then splits paths to produce two adversarial losses that feed the generator network in order to capture both local continuity of image texture and pervasive global features in images. The proposed framework is evaluated extensively, and the results including comparison to recent state-of-the-art demonstrate that it achieves considerable improvements on both visual and quantitative evaluations.