Image Inpainting via Generative Multi-column Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a generative multi-column network for image inpainting. This network synthesizes different image components in a parallel manner within one stage. To better characterize global structures, we design a confidence-driven reconstruction loss while an implicit diversified MRF regularization is adopted to enhance local details. The multi-column network combined with the reconstruction and MRF loss propagates local and global information derived from context to the target inpainting regions. Extensive experiments on challenging street view, face, natural objects and scenes manifest that our method produces visual compelling results even without previously common post-processing.
Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 23; 2022: 22; 2023: 15; 2024: 8; 2025: 4; 2026: 8.
81 papers.
Sort:
By area:
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2021MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolutioncited by 79
- 2021Open-World Entity Segmentationcited by 74
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2021WaveFill: A Wavelet-based Generation Network for Image Inpaintingcited by 44
38 more
- 2023Learning Disentangled Avatars with Hybrid 3D Representationscited by 44
- 2022Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesiscited by 43
- 2023Reference-guided Controllable Inpainting of Neural Radiance Fieldscited by 40
- 2021Image Inpainting by End-to-End Cascaded Refinement with Mask Awarenesscited by 35
- 2021SketchEdit: Mask-Free Local Image Manipulation with Partial Sketchescited by 32
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Inputcited by 22
- 2021Image Inpainting with External-internal Learning and Monochromic Bottleneckcited by 21
- 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Modelcited by 20
- 2021MLReal: Bridging the gap between training on synthetic data and real data applications in machine learningcited by 19
- 2022PalGAN: Image Colorization with Palette Generative Adversarial Networkscited by 15
- 2023Learning Image-Adaptive Codebooks for Class-Agnostic Image Restorationcited by 13
- 2021Bridging the Visual Gap: Wide-Range Image Blendingcited by 12
- 2024GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similaritycited by 12
- 2022Generalised Image Outpainting with U-Transformercited by 11
- 2022Unbiased Multi-Modality Guidance for Image Inpaintingcited by 10
- 2021Markpainting: Adversarial Machine Learning meets Inpaintingcited by 9
- 2022Image Inpainting via Iteratively Decoupled Probabilistic Modelingcited by 9
- 2023Adapt and Diffuse: Sample-adaptive Reconstruction via Latent Diffusion Modelscited by 9
- 2022Shape-guided Object Inpaintingcited by 8
- 2022Semi-Supervised Video Inpainting with Cycle Consistency Constraintscited by 8
- 2022PolypConnect: Image inpainting for generating realistic gastrointestinal tract images with polypscited by 7
- 2024EgoAvatar: Egocentric View-Driven and Photorealistic Full-body Avatarscited by 7
- 2024Real-time Free-view Human Rendering from Sparse-view RGB Videos using Double Unprojected Texturescited by 7
- 2021Contrastive Attention Network with Dense Field Estimation for Face Completioncited by 6
- 2024Transformer-based Image and Video Inpainting: Current Challenges and Future Directionscited by 6
- 2020Restoring Spatially-Heterogeneous Distortions using Mixture of Experts Networkcited by 5
- 2023TransRef: Multi-Scale Reference Embedding Transformer for Reference-Guided Image Inpaintingcited by 5
- 2021In-N-Out: Towards Good Initialization for Inpainting and Outpaintingcited by 4
- 2021Fully Context-Aware Image Inpainting with a Learned Semantic Pyramidcited by 4
- 2022Do Inpainting Yourself: Generative Facial Inpainting Guided by Exemplarscited by 4
- 2022Contrastive Learning for Diverse Disentangled Foreground Generationcited by 4
- 2022Coarse-to-fine Task-driven Inpainting for Geoscience Imagescited by 4
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generationcited by 4
- 2023GRIG: Few-Shot Generative Residual Image Inpaintingcited by 4
- 2023AVFace: Towards Detailed Audio-Visual 4D Face Reconstructioncited by 4
- 2023SAIR: Learning Semantic-aware Implicit Representationcited by 3
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotationscited by 3
50 most cited of 81 All 81 (JSON)
- 2026Context-Aware Mutual Learning for Blind Image Inpainting and Beyond13 Sep 2026
- 2026Partition-Aware Unlearning for Removing Spurious Correlations in Large Vision-Language Models30 Aug 2026
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026When Both Layers Learn: Training Dynamics of Representing Linear Models via ReLU Networks3 Jun 2026
- 2026EgoRelight: Egocentric Human Capture and Illumination Recovery for Relightable and Photoreal Avatar Rendering27 May 2026
- 2026MUA: Mobile Ultra-detailed Animatable Avatars20 Apr 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2026SelfieAvatar: Real-time Head Avatar reenactment from a Selfie Video26 Jan 2026
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment2 Jun 2025
- 2025High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion17 Apr 2025
- 2025Task-based Loss Functions in Computer Vision: A Comprehensive Review5 Apr 2025
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotations3 Feb 2025
38 more
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
- 2024Real-time Free-view Human Rendering from Sparse-view RGB Videos using Double Unprojected Textures17 Dec 2024
- 2024Disambiguating Monocular Reconstruction of 3D Clothed Human with Spatial-Temporal Transformer21 Oct 2024
- 2024Task-Decoupled Image Inpainting Framework for Class-specific Object Remover3 Oct 2024
- 2024EgoAvatar: Egocentric View-Driven and Photorealistic Full-body Avatars22 Sep 2024
- 2024GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similarity17 Jul 2024
- 2024FALCON: Frequency Adjoint Link with CONtinuous Density Mask for Fast Single Image Dehazing1 Jul 2024
- 2024Transformer-based Image and Video Inpainting: Current Challenges and Future Directions28 Jun 2024
- 2023SAIR: Learning Semantic-aware Implicit Representation13 Oct 2023
- 2023Drivable Avatar Clothing: Faithful Full-Body Telepresence with Dynamic Clothing Driven by Sparse RGB-D Input9 Oct 2023
- 2023Adapt and Diffuse: Sample-adaptive Reconstruction via Latent Diffusion Models12 Sep 2023
- 2023Learning Disentangled Avatars with Hybrid 3D Representations12 Sep 2023
- 2023A 3M-Hybrid Model for the Restoration of Unique Giant Murals: A Case Study on the Murals of Yongle Palace12 Sep 2023
- 2023Both Spatial and Frequency Cues Contribute to High-Fidelity Image Inpainting15 Jul 2023
- 2023Deep image prior inpainting of ancient frescoes in the Mediterranean Alpine arc25 Jun 2023
- 2023TransRef: Multi-Scale Reference Embedding Transformer for Reference-Guided Image Inpainting20 Jun 2023
- 2023Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Model13 Jun 2023
- 2023Learning Image-Adaptive Codebooks for Class-Agnostic Image Restoration10 Jun 2023
- 2023Enhancing Gappy Speech Audio Signals with Generative Adversarial Networks9 May 2023
- 2023AVFace: Towards Detailed Audio-Visual 4D Face Reconstruction25 Apr 2023
- 2023GRIG: Few-Shot Generative Residual Image Inpainting24 Apr 2023
- 2023Reference-guided Controllable Inpainting of Neural Radiance Fields19 Apr 2023
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generation5 Apr 2023
- 2022ECON: Explicit Clothed humans Optimized via Normal integration14 Dec 2022
- 2022Image Inpainting via Iteratively Decoupled Probabilistic Modeling6 Dec 2022
- 2022WSSL: Weighted Self-supervised Learning Framework For Image-inpainting25 Nov 2022
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fields22 Nov 2022
- 2022Coarse-to-fine Task-driven Inpainting for Geoscience Images20 Nov 2022
- 2022PrivacyProber: Assessment and Detection of Soft-Biometric Privacy-Enhancing Techniques16 Nov 2022
- 2022Contrastive Learning for Diverse Disentangled Foreground Generation4 Nov 2022
- 2022PalGAN: Image Colorization with Palette Generative Adversarial Networks20 Oct 2022
- 2022Capturing and Animation of Body and Clothing from Monocular Video4 Oct 2022
- 2022Unbiased Multi-Modality Guidance for Image Inpainting25 Aug 2022
- 2022Semi-Supervised Video Inpainting with Cycle Consistency Constraints14 Aug 2022
- 2022PolypConnect: Image inpainting for generating realistic gastrointestinal tract images with polyps30 May 2022
- 2022Multi-Label Logo Recognition and Retrieval based on Weighted Fusion of Neural Features11 May 2022
- 2022An Analysis of Generative Methods for Multiple Image Inpainting4 May 2022
- 2022Shape-guided Object Inpainting16 Apr 2022
50 newest of 81 All 81 (JSON)
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2022Capturing and Animation of Body and Clothing from Monocular Videocited by 83
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2021MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolutioncited by 79
- 2021Open-World Entity Segmentationcited by 74
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2021WaveFill: A Wavelet-based Generation Network for Image Inpaintingcited by 44
12 most cited of 75 All 75 (JSON)
- 2026Context-Aware Mutual Learning for Blind Image Inpainting and Beyond13 Sep 2026
- 2026AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures20 Aug 2026
- 2026When Both Layers Learn: Training Dynamics of Representing Linear Models via ReLU Networks3 Jun 2026
- 2026EgoRelight: Egocentric Human Capture and Illumination Recovery for Relightable and Photoreal Avatar Rendering27 May 2026
- 2026MUA: Mobile Ultra-detailed Animatable Avatars20 Apr 2026
- 2026Transformer-Based Inpainting for Real-Time 3D Streaming in Sparse Multi-Camera Setups5 Mar 2026
- 2026SelfieAvatar: Real-time Head Avatar reenactment from a Selfie Video26 Jan 2026
- 2025UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment2 Jun 2025
- 2025High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion17 Apr 2025
- 2025Task-based Loss Functions in Computer Vision: A Comprehensive Review5 Apr 2025
- 2025BVINet: Unlocking Blind Video Inpainting with Zero Annotations3 Feb 2025
- 2024MGAN-CRCM: A Novel Multiple Generative Adversarial Network and Coarse-Refinement Based Cognizant Method for Image Inpainting25 Dec 2024
12 newest of 75 All 75 (JSON)