EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning
Not on the map. Why?
Abstract (arXiv)
Over the last few years, deep learning techniques have yielded significant improvements in image inpainting. However, many of these techniques fail to reconstruct reasonable structures as they are commonly over-smoothed and/or blurry. This paper develops a new approach for image inpainting that does a better job of reproducing filled regions exhibiting fine details. We propose a two-stage adversarial model EdgeConnect that comprises of an edge generator followed by an image completion network. The edge generator hallucinates edges of the missing region (both regular and irregular) of the image, and the image completion network fills in the missing regions using hallucinated edges as a priori. We evaluate our model end-to-end over the publicly available datasets CelebA, Places2, and Paris StreetView, and show that it outperforms current state-of-the-art techniques quantitatively and qualitatively. Code and models available at: https://github.com/knazeri/edge-connect
Key facts. Cited by 161 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 45; 2022: 42; 2023: 37; 2024: 23; 2025: 9; 2026: 5.
161 papers.
Sort:
By area:
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
- 2023Flow Matching in Latent Spacecited by 155
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
38 more
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2023Residual Denoising Diffusion Modelscited by 68
- 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
- 2022CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Trainingcited by 49
- 2021TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformationscited by 48
- 2023Designing a Better Asymmetric VQGAN for StableDiffusioncited by 45
- 2021WaveFill: A Wavelet-based Generation Network for Image Inpaintingcited by 44
- 2022NeRF-In: Free-Form NeRF Inpainting with RGB-D Priorscited by 43
- 2021Finding and Fixing Spurious Patterns with Explanationscited by 38
- 2022Gradient Obfuscation Gives a False Sense of Security in Federated Learningcited by 37
- 2021Image Inpainting by End-to-End Cascaded Refinement with Mask Awarenesscited by 35
- 2022Do better ImageNet classifiers assess perceptual similarity better?cited by 34
- 2023CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Queryingcited by 34
- 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
- 2024DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detectioncited by 33
- 2021Voxel-based Network for Shape Completion by Leveraging Edge Generationcited by 32
- 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 32
- 2021Learning by Planning: Language-Guided Global Image Editingcited by 25
- 2022Keys to Better Image Inpainting: Structure and Texture Go Hand in Handcited by 25
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
- 2024ScribbleLight: Single Image Indoor Relighting with Scribblescited by 22
- 2021Image Inpainting with External-internal Learning and Monochromic Bottleneckcited by 21
- 2023Look Ma, No Hands! Agent-Environment Factorization of Egocentric Videoscited by 21
- 2021Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesiscited by 20
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 20
- 2021Internal Video Inpainting by Implicit Long-range Propagationcited by 19
- 2021Free-form tumor synthesis in computed tomography images via richer generative adversarial networkcited by 16
- 2021Detailed Avatar Recovery from Single Imagecited by 16
- 2023KD-DLGAN: Data Limited Image Generation via Knowledge Distillationcited by 16
- 2021TrajeVAE: Controllable Human Motion Generation from Trajectoriescited by 14
- 2021GenCo: Generative Co-training for Generative Adversarial Networks with Limited Datacited by 14
- 2022Volumetric Disentanglement for 3D Scene Manipulationcited by 13
- 2023Learning Image-Adaptive Codebooks for Class-Agnostic Image Restorationcited by 13
- 2022DeViT: Deformed Vision Transformers in Video Inpaintingcited by 12
- 2023RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detectioncited by 12
50 most cited of 161 All 161 (JSON)
- 2026Visual Retrieval-Augmented Generation for Silhouette-Guided Animal Art16 Jun 2026
- 2026Face inpainting with Identity Preserving Latent Diffusion Models15 May 2026
- 2026Exploring Clustering Capability of Inpainting Model Embeddings for Pattern-based Individual Identification6 May 2026
- 2026Diffusion Autoencoder for Unsupervised Artifact Restoration in Handheld Fundus Images17 Apr 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2025Detecting Localized Deepfakes: How Well Do Synthetic Image Detectors Handle Inpainting?18 Dec 2025
- 2025IS-Diff: Improving Diffusion-Based Inpainting with Better Initial Seed15 Sep 2025
- 2025Video Color Grading via Look-Up Table Generation1 Aug 2025
- 2025Clutter Detection and Removal by Multi-Objective Analysis for Photographic Guidance19 Jul 2025
- 2025Exploring Diffusion with Test-Time Training on Efficient Image Restoration17 Jun 2025
- 2025From Missing Pieces to Masterpieces: Image Completion with Context-Adaptive Diffusion19 Apr 2025
- 2025DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images18 Apr 2025
38 more
- 2025Binary Diffusion Probabilistic Model23 Jan 2025
- 2025InpDiffusion: Image Inpainting Localization via Conditional Diffusion Models6 Jan 2025
- 20243D Face Reconstruction With Geometry Details From a Single Color Image Under Occluded Scenes25 Dec 2024
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
- 2024Generative Face Parsing Map Guided 3D Face Reconstruction Under Occluded Scenes25 Dec 2024
- 2024AsyncDSB: Schedule-Asynchronous Diffusion Schr"odinger Bridge for Image Inpainting11 Dec 2024
- 2024Diffusion Models with Anisotropic Gaussian Splatting for Image Inpainting2 Dec 2024
- 2024ScribbleLight: Single Image Indoor Relighting with Scribbles26 Nov 2024
- 2024Local Lesion Generation is Effective for Capsule Endoscopy Image Data Augmentation in a Limited Data Setting5 Nov 2024
- 2024RetCompletion:High-Speed Inference Image Completion with Retentive Network5 Oct 2024
- 2024GroupDiff: Diffusion-based Group Portrait Editing22 Sep 2024
- 2024Deep Generative Adversarial Network for Occlusion Removal from a Single Image20 Sep 2024
- 2024Face Mask Removal with Region-attentive Face Inpainting10 Sep 2024
- 2024Single-image coherent reconstruction of objects and humans15 Aug 2024
- 2024DAFT-GAN: Dual Affine Transformation Generative Adversarial Network for Text-Guided Image Inpainting9 Aug 2024
- 2024MxT: Mamba x Transformer for Image Inpainting23 Jul 2024
- 2024Assessing Image Inpainting via Re-Inpainting Self-Consistency Evaluation25 May 2024
- 2024Multi-scale Semantic Prior Features Guided Deep Neural Network for Urban Street-view Image17 May 2024
- 2024A Comprehensive Survey of Masked Faces: Recognition, Detection, and Unmasking9 May 2024
- 2024Sketch-guided Image Inpainting with Partial Discrete Diffusion Process18 Apr 2024
- 2024Towards Online Real-Time Memory-based Video Inpainting Transformers24 Mar 2024
- 2024Attack Deterministic Conditional Image Generative Models for Diverse and Controllable Generation13 Mar 2024
- 2024Windowed-FourierMixer: Enhancing Clutter-Free Room Modeling with Fourier Transform28 Feb 2024
- 2024HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attention22 Feb 2024
- 2024DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detection4 Jan 2024
- 2023Wild2Avatar: Rendering Humans Behind Occlusions31 Dec 2023
- 2023On Mask-based Image Set Desensitization with Recognition Support14 Dec 2023
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpainting6 Dec 2023
- 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolution27 Nov 2023
- 2023Distance Weighted Trans Network for Image Completion11 Oct 2023
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model11 Oct 2023
- 2023Pixel-Inconsistency Modeling for Image Manipulation Localization30 Sep 2023
- 2023A novel approach for holographic 3D content generation without depth map26 Sep 2023
- 2023A 3M-Hybrid Model for the Restoration of Unique Giant Murals: A Case Study on the Murals of Yongle Palace12 Sep 2023
- 2023Memory augment is All You Need for image restoration4 Sep 2023
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translation26 Aug 2023
- 2023Residual Denoising Diffusion Models25 Aug 2023
- 2023Staging E-Commerce Products for Online Advertising using Retrieval Assisted Image Generation28 Jul 2023
50 newest of 161 All 161 (JSON)
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
- 2023DiffIR: Efficient Diffusion Model for Image Restorationcited by 253
- 2023Flow Matching in Latent Spacecited by 155
- 2023Residual Denoising Diffusion Modelscited by 68
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
- 2023Designing a Better Asymmetric VQGAN for StableDiffusioncited by 45
- 2024DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detectioncited by 33
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translationcited by 24
- 2023Look Ma, No Hands! Agent-Environment Factorization of Egocentric Videoscited by 21
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 20
- 2024Sketch-guided Image Inpainting with Partial Discrete Diffusion Processcited by 7
12 most cited of 19 All 19 (JSON)
- 2026Face inpainting with Identity Preserving Latent Diffusion Models15 May 2026
- 2025IS-Diff: Improving Diffusion-Based Inpainting with Better Initial Seed15 Sep 2025
- 2025From Missing Pieces to Masterpieces: Image Completion with Context-Adaptive Diffusion19 Apr 2025
- 2025Binary Diffusion Probabilistic Model23 Jan 2025
- 2025InpDiffusion: Image Inpainting Localization via Conditional Diffusion Models6 Jan 2025
- 2024Diffusion Models with Anisotropic Gaussian Splatting for Image Inpainting2 Dec 2024
- 2024Sketch-guided Image Inpainting with Partial Discrete Diffusion Process18 Apr 2024
- 2024DiffusionEdge: Diffusion Probabilistic Model for Crisp Edge Detection4 Jan 2024
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model11 Oct 2023
- 2023DiffI2I: Efficient Diffusion Model for Image-to-Image Translation26 Aug 2023
- 2023Residual Denoising Diffusion Models25 Aug 2023
- 2023Flow Matching in Latent Space17 Jul 2023
12 newest of 19 All 19 (JSON)
- 2024MxT: Mamba x Transformer for Image Inpaintingcited by 1
- 2024MxT: Mamba x Transformer for Image Inpainting23 Jul 2024
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021Diverse Image Inpainting with Bidirectional and Autoregressive Transformerscited by 80
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
12 most cited of 139 All 139 (JSON)
- 2026Visual Retrieval-Augmented Generation for Silhouette-Guided Animal Art16 Jun 2026
- 2026Exploring Clustering Capability of Inpainting Model Embeddings for Pattern-based Individual Identification6 May 2026
- 2026Diffusion Autoencoder for Unsupervised Artifact Restoration in Handheld Fundus Images17 Apr 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2025Detecting Localized Deepfakes: How Well Do Synthetic Image Detectors Handle Inpainting?18 Dec 2025
- 2025Video Color Grading via Look-Up Table Generation1 Aug 2025
- 2025Clutter Detection and Removal by Multi-Objective Analysis for Photographic Guidance19 Jul 2025
- 2025Exploring Diffusion with Test-Time Training on Efficient Image Restoration17 Jun 2025
- 2025DanceText: A Training-Free Layered Framework for Controllable Multilingual Text Transformation in Images18 Apr 2025
- 20243D Face Reconstruction With Geometry Details From a Single Color Image Under Occluded Scenes25 Dec 2024
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
- 2024Generative Face Parsing Map Guided 3D Face Reconstruction Under Occluded Scenes25 Dec 2024
12 newest of 139 All 139 (JSON)